Upstream/yt-dlp
1
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2024-12-12 14:26:49 +01:00
Code Issues Packages Projects Releases Wiki Activity
18,818 Commits 3 Branches 102 Tags 189 MiB
19bb39202d
Commit Graph

194 Commits

Author SHA1 Message Date
pukkandan
56d868dbb7
Allow running some postprocessors before actual download 2021-04-12 02:12:46 +05:30
coletdjnz
f4f751af40
[youtube] Parse API parameters from initial webpage (#230) 
* Obtain innertube_context, api_key and x-goog-visitor-id from webpage
* Generalize the header & Innertube_context extraction across YouTube extractors

Related: 1b0a13f33c

Authored by: colethedj
 2021-04-12 01:53:04 +05:30
pukkandan
1988fab7e3
[youtube] Fix thumbnail URL 
Closes: https://github.com/yt-dlp/yt-dlp/issues/233 https://github.com/ytdl-org/youtube-dl/issues/28023
 2021-04-11 06:06:13 +05:30
pukkandan
9de3ea3126
Pass any field to --exec using similar syntax to output template 
Related: https://github.com/ytdl-org/youtube-dl/issues/28642
 2021-04-11 06:06:12 +05:30
pukkandan
e01d6aa435
Fix mergeall when requested formats are unavailable 2021-04-10 22:29:58 +05:30
pukkandan
f7ad71607d
Update to ytdl-commit-4fb25ff 
[maoritv] Add new extractor
4fb25ff5a3

Except:
[vimeo] improve extraction 3ae9c0f410
[youtube:tab] Pass innertube context... 1b0a13f33c
 2021-04-10 22:19:54 +05:30
pukkandan
68379de561
[downloaders] Fix API access 
Bug introduced by: 52a8a1e1b9
 2021-04-10 21:15:32 +05:30
pukkandan
d9aa233295
Deprecate more options 
* `--all-formats` = `-f all`
* `--include-ads` is not implemented
 2021-04-10 20:58:36 +05:30
pukkandan
f37468c41f
Fix default of dynamic_mpd 2021-04-10 20:57:53 +05:30
pukkandan
52a8a1e1b9
Option to choose different downloader for different protocols 
* Renamed `--external-downloader-args` to `--downloader-args`
* Added `native` as an option for the downloader
* Use similar syntax to `--downloader-args` etc. Eg: `--downloader dash:native --downloader aria2c`
* Deprecated `--hls-prefer-native` and `--hls-prefer-ffmpeg` since the same can now be done with `--downloader "m3u8:native"` and `m3u8:ffmpeg` respectively
* Split `frag_urls` protocol into `m3u8_frag_urls` and `dash_frag_urls`
* Standardize shortening of protocol names with `downloader.shorten_protocol_name`
 2021-04-10 20:57:52 +05:30
pukkandan
d818eb7473
Improve argument parsing for -P, -o, -S 
* `-P "subtitle,thumbnail:PATH"` is now possible. Similarly for `-o`
* `-S "fps,br" -S "res,codec"` is now interpreted as `-S res,codec,fps,br`. Previously, `-S fps,br` was ignored in this case.
 2021-04-10 20:57:27 +05:30
pukkandan
f8d4ad9ab0
Format selector mergeall to download and merge all formats 2021-04-10 20:57:27 +05:30
pukkandan
3ffc7c89b0
[youtube] Fix _extract_alerts 
* Sometimes one warning is split between multiple runs
* Also simplified code
 2021-04-10 20:57:27 +05:30
Henrik Heimbuerger
f1823403b0
[nebula] Add extractor (watchnebula.com) (#122) 
Authored by: hheimbuerger
 2021-04-09 16:57:38 +05:30
LE
384fb069ec
[NFHSNetwork] Add extractor (#217) 
Authored by: llacb47
 2021-04-09 15:33:10 +05:30
bopol
a4ddaf231e
[nitter] Fix extraction of reply tweets (#218) 
And update instance list

Closes #215 

Authored by: B0pol
 2021-04-08 22:33:36 +05:30
pukkandan
7e60c06925
[bilibili] Fix uploader 
Related: https://github.com/yt-dlp/yt-dlp/issues/222
 2021-04-08 13:22:04 +05:30
coletdjnz
d92f5d5a90
[youtube] Extract comments' approximate timestamp (#221) 
Authored by: colethedj
 2021-04-07 17:09:06 +05:30
colethedj
9e62f283ff
[utils] Add datetime_from_str to parse relative time (#221) 
and `datetime_add_months` to accurately add/subtract months

Authored by: colethedj
 2021-04-07 17:09:06 +05:30
bopol
c24ce07a84
[nitter] Fix thumbnails (#216) 
Authored by: B0pol
 2021-04-05 16:53:33 +05:30
Ashish
de6758128e
[DiscoveryPlusIndia] Add DiscoveryPlusIndiaShowIE (#213) 
Co-authored-by: Ashish <ashish@pop-os.localdomain>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2021-04-05 16:20:08 +05:30
pukkandan
73d4343e39
Fix some m3u8 not obeying --allow-unplayable-formats 2021-04-04 17:53:26 +05:30
pukkandan
57d104424f
[version] update 
:ci skip all
 2021-04-04 03:57:29 +05:30
pukkandan
39ed931e53
Update to ytdl-commit-654b4f4 
[youtube] prioritize information from YoutubeIE for playlist entries
654b4f4ff2
 2021-04-04 03:49:04 +05:30
Matthew
b28f8d244a
[YouTube] Show premium state in availability (#209) 
Authored by colethedj
 2021-04-03 14:20:58 +05:30
pukkandan
73cd218f5a
[documentation] Improve --parse-metadata documentation 2021-04-03 14:07:29 +05:30
pukkandan
84601bb72b
Ability to set a specific field in the file's metadata 
Eg: `--parse-metadata "description:(?s)(?P<meta_comment>.+)"`
sets the "comment" field using `description`
 2021-04-03 14:07:28 +05:30
pukkandan
54df8fc5b2
[ViewSource] Add extractor to handle view-source: 2021-04-03 14:07:27 +05:30
The Hatsune Daishi
5d39972ed0
[mildom] Update extractor to comply with current proxy (#212) 
Authored by nao20010128nao
 2021-04-03 13:43:49 +05:30
pukkandan
0481374e1d
[DiscoveryPlus] Add discoveryplus.in (#203) 
Closes #201
 2021-04-03 13:18:40 +05:30
pukkandan
eff635394a
Ability to select nth best format 
Eg: -f `bv*.2`

* Also cleaned up the related format selection code
 2021-04-02 22:16:52 +05:30
pukkandan
df0c81513e
[generic] Detect Invidious' link element (Closes #195) 2021-04-01 17:13:35 +05:30
pukkandan
3f6a90eb63
[ard:mediathek] Fix video id extraction (Closes #202) 2021-04-01 16:17:15 +05:30
pukkandan
b050d210df
Fix some typos and linter 2021-04-01 14:16:10 +05:30
pukkandan
f4e4be19f0
[sponskrub] Run before embedding thumbnail 
Workaround for https://github.com/faissaloo/SponSkrub/issues/29
Closes https://github.com/yt-dlp/yt-dlp/issues/204
 2021-04-01 14:13:24 +05:30
pukkandan
cce889b900 Update to ytdl v2021-04-01 
14f29f087e

Closes #205
 2021-04-01 13:59:22 +05:30
nixxo
a6ae61a4c2
[la7] Add podcasts and podcast playlists (#198) 
Authored by: nixxo
 2021-03-28 17:06:59 +05:30
pukkandan
b23b9eefd9
[version] update 2021-03-25 04:44:22 +05:30
pukkandan
a2f0b0c672
Release 2021.03.24.1 2021-03-25 04:33:34 +05:30
pukkandan
b704fc1a68
Revert commit 8562218 
[ard] improve clip id extraction
8562218350

This was merged incorrectly
 2021-03-25 04:31:32 +05:30
pukkandan
a3affbe6a0
Release 2021.03.24 2021-03-25 04:18:37 +05:30
pukkandan
1418a0437f
Update to ytdl-commit-8562218 
[ard] improve clip id extraction
8562218350
 2021-03-25 04:09:21 +05:30
pukkandan
143db31d48
Parse metadata from multiple fields 
Closes #196
 2021-03-25 03:32:15 +05:30
pukkandan
3700c7ef10
[linuxacadamy] Fix login 2021-03-24 04:06:26 +05:30
pukkandan
498f560638
Ability to load playlist infojson 
* If `--no-clean-infojson` is given, the video ids are saved/loaded from in the infojson along with their playlist index
* If a video entry that was not saved is requested, we fallback to using `webpage_url` to re-extract the entries

Related: https://github.com/yt-dlp/yt-dlp/issues/190#issuecomment-804921024
 2021-03-24 01:57:50 +05:30
pukkandan
394dcd4486
Write current epoch to infojson when using --no-clean-infojson 
Closes #191
 2021-03-24 00:34:33 +05:30
pukkandan
83b20a970d
[youtube_live_chat] fix bug when trying to set cookies 
Closes #194
 2021-03-23 17:53:36 +05:30
pukkandan
e1feb88fdf
[niconico] Fix for when logged in 
Related: https://github.com/yt-dlp/yt-dlp/issues/171#issuecomment-803692716
Co-authored by: CXwudi, xtkoba
 2021-03-23 14:03:07 +05:30
pukkandan
389b9dbbcc
[version] update 2021-03-22 03:03:06 +05:30
pukkandan
421a459573
Update to ytdl-commit-7e79ba7 
7e79ba7dd6
[vimeo:album] Fix extraction for albums with number of videos multiple to page size
 2021-03-22 02:58:41 +05:30
Matthew
c224251aad
[youtube] Show if video is private, unlisted etc in new field availability (#188) 
Closes: #185, https://github.com/ytdl-org/youtube-dl/issues/25631

Authored by: colethedj, pukkandan
 2021-03-22 02:58:41 +05:30
pukkandan
037cc66ec8
[linuxacadamy] Improve regex 
TODO: We need to make a more robust standard regex for fetching js objects from html
 2021-03-21 21:27:33 +05:30
Two Sheds" Jackson
9160a0c6a2
[nbc] Improve metadata extraction (#187) 
Authored by: 2ShedsJackson
 2021-03-21 21:26:31 +05:30
2ShedsJackson
5c5fae6d2f
[amcnetworks] Fix extractor (#179) 
* Prefer use of manifest based on `releasePid` since the one based on `videoPid` may have Fairplay
* Additional thumbnail images were added
* Don't add `season_number` and `series` to `title`
* `series` is now set to `None` rather than "_" when empty
* fix bug with age limit

Authored by: 2ShedsJackson
 2021-03-20 16:11:11 +05:30
pukkandan
c1d3a4a8f0
[niconico] Add user extractor 
Co-authored by: animelover1984
 2021-03-20 14:59:39 +05:30
pukkandan
adc74b3c6d
[bilibili] Add anthology support 
Closes: #118

Co-authored by: animelover1984
 2021-03-20 14:56:42 +05:30
pukkandan
beb4b92a66
More consistent warning messages (#173) 
Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>
 2021-03-20 09:34:52 +05:30
pukkandan
cd9b384cc3
Embed video URL metadata inside MP4 (#173) 
`mp4` has `comment` and `synopsis`; the synopsis is expected to have the long description
So we save the `webpage_url` to `comment` and `description` to `synopsis`

Related: https://github.com/ytdl-org/youtube-dl/issues/28478

Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>
 2021-03-20 09:34:52 +05:30
pukkandan
4d971a16b8
Merge webm formats into mkv if thumbnails are to be embedded (#173) 
Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>
 2021-03-20 09:34:52 +05:30
Damiano Amatruda
3561530776
Parse resolution in info dictionary (#173) 2021-03-20 09:34:52 +05:30
Damiano Amatruda
4690688658
Use headers and cookies when downloading subtitles (#173) 2021-03-20 09:34:52 +05:30
pukkandan
fe845284c4
[aria2c] Support retry/abort unavailable fragments (#173) 
Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>
 2021-03-20 09:33:33 +05:30
pukkandan
2b3bf01c90 [aria2c] Better default arguments 2021-03-20 09:31:53 +05:30
pukkandan
23c1a66730 Make sure post_hook gets the final filename 2021-03-20 09:31:53 +05:30
pukkandan
dd18a58cb1 [documentation] Add SplitChapters to --ppa 2021-03-20 09:31:53 +05:30
pukkandan
a94bfd6cfe [splitchapters] Fix for older ffmpeg 
Older versions of ffmpeg doesn't allow `-to` as an input option
Closes #180
 2021-03-20 09:31:53 +05:30
pukkandan
a515a78dd3
fix some typos and linter 2021-03-18 22:19:31 +05:30
pukkandan
e167860ce7
[documentation] Add deprecated options and aliases in readme 2021-03-18 22:07:50 +05:30
pukkandan
75d43ca080
Option to keep private keys in the infojson 
Options: --clean-infojson, --no-clean-infojson

Related: https://github.com/yt-dlp/yt-dlp/issues/42#issuecomment-800778391
 2021-03-18 21:00:45 +05:30
pukkandan
5226731e2d
Recursively remove private keys from infojson 
Related: https://github.com/yt-dlp/yt-dlp/issues/42
 2021-03-18 21:00:45 +05:30
pukkandan
dcf64d43e0
[movefiles] Fix bugs and make more robust 2021-03-18 20:54:53 +05:30
pukkandan
e3c076970e
[youtube] bugfix for channel playlist extraction 
Bug introduced in cd7c66cf01
 2021-03-17 17:35:02 +05:30
pukkandan
7978e172f3
[niconico] Partial fix 
TODO:
Smile formats don't work
Extraction code that no longer works needs to be removed

Adapted from:
b5eff52dd9
by animelover1984

Related:
https://github.com/yt-dlp/yt-dlp/issues/171
https://github.com/animelover1984/youtube-dl/issues/29
https://github.com/ytdl-org/youtube-dl/issues/28470
 2021-03-17 15:38:24 +05:30
nixxo
605d299f83
[stitcher] Merge from youtube-dl (#175) 
This cherry-picks the commits:
a563c97c5c (diff-cc37718b18689c1c0588c4c74518853ef43ab020bbd674f3c04d4eae037798d2)
8522bcd97c (diff-cc37718b18689c1c0588c4c74518853ef43ab020bbd674f3c04d4eae037798d2)

Authored by: nixxo
 2021-03-16 15:32:10 +05:30
nixxo
18c1f04362
[rcs] Improved extraction (See desc) (#170) 
* improved `video_data` extraction
* added an extra fallback value for `description`
* improved regex in `RCSVariousIE`

Authored by: nixxo
 2021-03-16 00:26:29 +05:30
pukkandan
e4beae703d
[formatSort] Fix quality being ignored 
Closes #172
 2021-03-15 23:55:53 +05:30
pukkandan
d034ab669c
[sponskrub] Pass proxy to sponskrub 
Needs atleast sponskrub version:
    faissaloo/sponskrub 3.7.0
    OR yt-dlp/sponskrub 2021.03.15
 2021-03-15 06:27:21 +05:30
pukkandan
5aeefbd633
[version] update 
:ci skip all
 2021-03-15 06:03:59 +05:30
pukkandan
597c18665e
Release 2021.03.15 2021-03-15 05:54:39 +05:30
pukkandan
10db0d2f57
Update to ytdl-commit-3be0980 
3be098010f
 2021-03-15 04:52:06 +05:30
pukkandan
7275535116
Split video by chapters (#158) 
* New options `--split-chapters` and `--no-split-chapters`
* The output/path of the split files can be given using the key `chapter`
* Additional keys `section_title`, `section_number`, `section_start`, `section_end` are available in the output template
* Alias `--split-tracks` for parity with animelover/youtube-dl
* `--sponskrub-cut` and `--split-chapter` cannot work together

Closes:
https://github.com/blackjack4494/yt-dlc/issues/277
https://github.com/ytdl-org/youtube-dl/issues/28438
https://github.com/ytdl-org/youtube-dl/issues/12907
https://github.com/ytdl-org/youtube-dl/issues/6480
https://github.com/ytdl-org/youtube-dl/pull/25005

Rewritten from the implementation by: femaref and Wattux
https://github.com/Wattux/youtube-dl/tree/split-at-timestamps
https://github.com/ytdl-org/youtube-dl/pull/25005
https://github.com/femaref/youtube-dl/tree/split-track
 2021-03-15 04:32:13 +05:30
Matthew
a1c5d2ca64
[Youtube] Rewrite comment extraction (#167) 
Closes #121

TODO:
* Add an option for the user to specify newest/popular and max number of comments
* Refactor the download code and generalize with TabIE
* Parse time_text to timestamp
 2021-03-15 04:11:11 +05:30
pukkandan
ca87974543
[embedthumbnail] Set mtime correctly 
Related: https://github.com/yt-dlp/yt-dlp/issues/67
 2021-03-14 21:56:04 +05:30
pukkandan
e92caff5d5
Refactor (See desc) 
* Create `FFmpegPostProcessor.real_run_ffmpeg` that can accept multiple input/output files along with switches for each
* Rewrite `cli_configuration_args` and related functions
* Create `YoutubeDL._ensure_dir_exists` - this was previously defined in multiple places
 2021-03-14 20:02:55 +05:30
CHJ85
ea3a012d2a
[pluto.tv] Add extractor (#163) 
https://github.com/ytdl-org/youtube-dl/pull/27621

Authored by: kevinoconnor7
 2021-03-14 16:02:16 +05:30
pukkandan
5b8917fb52
[zee5] Support zee5originals 2021-03-14 15:22:29 +05:30
nixxo
8eec0120a2
[rai] fix drm check (#168) 
Bug introduced by #150
Authored by: nixxo
 2021-03-13 21:08:50 +05:30
shirt
4cf1e5d2f9
Native concurrent downloading of fragments (#166) 
* Option `--concurrent-fragments` (`-N`) to set the number of threads

Related: #165

Known issues:
* When receiving Ctrl+C, the process will exit only after finishing the currently downloading fragments
* The download progress shows the speed of only one thread

Authored by shirt-dev
 2021-03-13 10:16:58 +05:30
pukkandan
0a473f2f0f
More improvements to HLS/DASH external downloader code 
* Fix error when there is no `protocol` in `info_dict`
* Move HLS byte range detection to `Aria2cFD` so that the download will fall back to the native downloader instead of ffmpeg
* Fix bug with getting no fragments in DASH
* Convert `check_results` in `can_download` to a generator
 2021-03-11 22:07:42 +05:30
nixxo
e4edeb6226
[wimtv] Add extractor (#161) 
Added support for VODs, live and embeds

Authored by: nixxo
 2021-03-11 13:28:51 +05:30
Ashish
d488e254d9
[Zee5] Add Show Extractor (#160) 
Co-authored-by: Ashish <ashish@pop-os.localdomain>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2021-03-11 13:18:09 +05:30
shirt-dev
d7009caa03
Improve HLS/DASH external downloader code (#162) 
Authored by: shirt
 2021-03-10 20:09:40 +05:30
pukkandan
54759df586
[zee5] Improve regex 2021-03-09 15:17:16 +05:30
nixxo
605b684c2d
[mtv] Add mtv.it and extract series metadata (#156) 
* New extractors: MTVItalia, MTVItaliaProgramma
* Extract fields: series, season_number, episode_number

Authored-by: nixxo
 2021-03-08 19:10:27 +05:30
pukkandan
994443d24d
[version] update :ci skip all 2021-03-08 00:16:25 +05:30
teesid
1f52a09e2e
[vimeo] Fix videos with password 
https://github.com/ytdl-org/youtube-dl/pull/27992

Fixes: https://github.com/ytdl-org/youtube-dl/issues/28354

Authored by teesid
 2021-03-07 23:47:53 +05:30
pukkandan
fc21af505c
Fix some videos downloading with m3u8 extension 2021-03-07 23:22:12 +05:30
pukkandan
015f3b3120
[bilibili] Change Accept header (Closes #145) 
This is a temporary fix. Ideally we should find a more reasonable accept string that just "*/*"

Fixes: https://github.com/ytdl-org/youtube-dl/issues/28363 https://github.com/ytdl-org/youtube-dl/issues/28341

Thanks to animelover1984 for identifying the problem
 2021-03-07 17:59:59 +05:30
nixxo
0852947fcc
[rai] Check for DRM (#150) 
Authored by: nixxo <nixxo@protonmail.com>
 2021-03-07 13:01:59 +05:30
pukkandan
99594a11ce
Remove "fixup is ignored" warning when fixup wasn't passed by user 
Closes #151
 2021-03-07 12:32:59 +05:30