https:\/\/aria2.github.io\/<\/a> Even though a connection was being throttled to 50kb\/sec, no reason I cant have 10 at once going after the same file, just different segments. That got me to 500kb\/sec. It’s all I need. I don’t care if it’s slow. But if it takes weeks to complete, that’s time where the content could disappear. #balance<\/p>\n\n\n\nyoutube-dl --external-downloader aria2c --external-downloader-args \"-c -j 10 -x 10 -s 10 -k 1M\" -o \"F:\/Libraries\/Youtube Archive\/%(uploader)s\/%(upload_date)s-%(title)s.%(ext)s\" https:\/\/www.youtube.com\/c\/jamesbruton\/videos<\/pre>\n\n\n\nI know. Ugly. And powerful. It’s not that bad. What I want is a directory structure like:<\/p>\n\n\n\n
X:\n \\Libraries\n \\Youtube Archive\n \\James Bruton\n \\20190729-Completing the Robots' Mechanical Build.mp4\n 20190805-Simulating a Compliant Dampened Spring with Current Control.mp4\n 20190812-Building the Robots' Electronics.mp4\n ...\n \\Gear Down For What\n \\20170127-50_1 Compound Planetary 3D Printable Gearbox.mp4\n 20170309-3D Printed Plastic Robotic Arm Demo.mp4<\/pre>\n\n\n\nYou get the idea. So, I wrote this:<\/p>\n\n\n\n
youtube-dl \n--external-downloader aria2c <- Use the aria2 downloader\n--external-downloader-args <- pass these args to aria2\n \"-c <- continue downloading a partially downloaded file\n -j 10 <- maximum number of parallel downloads for every file\n -x 10 <- maximum number of connections to 1 server for each download\n -s 10 <- download a file using N connection\n -k 1M\" <- do not split less than 2*SIZE byte range\n-o \"F:\/Libraries\/Youtube Archive\/ <- Set output template for youtube-dl archive location\n %(uploader)s <- Name of the uploader (channel owner) string template\n \/ <- literal for the directory symbol\n %(upload_date)s <- Upload date for the file string template (YYYYMMDD)\n - <- Literal dash\n %(title)s <- Title of the video string template\n . <- Literal period\n %(ext)s\" <- Video file type extension\nhttps:\/\/www.youtube.com\/c\/jamesbruton\/videos <- URL for youtube-dl to examine<\/pre>\n\n\n\nIf you want to use it in a batch file, just be a little careful about the % symbol that youtube-dl uses to start a substitution string. It has to be escaped with an extra %. It caused me grief. Here’s the batch file version of the command above:<\/p>\n\n\n\n
youtube-dl --external-downloader aria2c --external-downloader-args \"-c -j 10 -x 10 -s 10 -k 1M\" -o \"F:\/Libraries\/Youtube Archive\/%%(uploader)s\/%%(upload_date)s-%%(title)s.%%(ext)s\" https:\/\/www.youtube.com\/c\/GearDownForWhat\/videos<\/pre>\n\n\n\nFinal note: I’ve dealt with 2 errors:<\/p>\n\n\n\n
- youtube-dl occasionally exits with a 403 error. Apparently it’s a known issue. clear the youtube-dl cache with “youtube-dl –rm-cache-dir”, and re-run the download command. it’ll skip anything it’s already done. In 600 videos, I had to do this 10-15 times?<\/li>
- aria2 occasionally aborts with error 22 (HTTP response header was bad or unexpected. Not much I can do about that! Re-run the download command. This one isn’t as frequent as the youtube-dl 403 issue<\/li><\/ol>\n\n\n\n
PS: youtube-dl? It downloads from thousands of other sites too. \ud83d\ude42 <\/p>\n","protected":false},"excerpt":{"rendered":"
Note: I started having trouble with this. It would appear they learned to throttle this as well. There is now a WAY better option that does all of this is one, and I finally have the holy grail I was looking for: archiving disappearing YouTube content before it disappears on […]<\/p>\n","protected":false},"author":1,"featured_media":234,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-231","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/varmintworks.com\/varmint-blog\/wp-content\/uploads\/2021\/10\/pngaaa.com-808842.png?fit=481%2C401&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/posts\/231","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/comments?post=231"}],"version-history":[{"count":13,"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/posts\/231\/revisions"}],"predecessor-version":[{"id":252,"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/posts\/231\/revisions\/252"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/media\/234"}],"wp:attachment":[{"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/media?parent=231"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/categories?post=231"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/varmintworks.com\/varmint-blog\/wp-json\/wp\/v2\/tags?post=231"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}