1
0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2025-02-28 03:01:30 +01:00
Commit Graph

447 Commits

Author SHA1 Message Date
pukkandan
052e135029
[youtube] Simplify _get_text early 2021-07-24 06:59:20 +05:30
pukkandan
3944e7af92
[youtube] Fix subtitles only being extracted from the first client
Closes 
2021-07-23 09:46:55 +05:30
pukkandan
ad34b2951e
Try all clients even if age-gated
Reverts: 892e31ce7c

If some API calls have any issue, saving the state will cause unnecessary errors
2021-07-23 09:46:54 +05:30
pukkandan
c8fa48fd94
[youtube] Disable get_video_info age-gate workaround
This now seems to be completely dead
Closes: 
2021-07-23 09:46:52 +05:30
coletdjnz
2fd226f6a7
[youtube] Fix age-gated videos for API clients when cookies are supplied ()
Fixes 
Authored by: colethedj
2021-07-22 08:11:04 +00:00
pukkandan
245524e6a3
Release 2021.07.21
and fix some typos
Closes 
2021-07-22 02:33:28 +05:30
pukkandan
9c0d7f4951
[youtube] Make --extractor-retries work for more errors
Closes 
2021-07-22 02:32:20 +05:30
coletdjnz
c926c9541f
[youtube] Add debug message for SAPISID cookie extraction ()
Authored by: colethedj
2021-07-21 20:45:05 +00:00
Matt Broadway
982ee69a74
Add option --cookies-from-browser to load cookies from a browser ()
* also adds `--no-cookies-from-browser`

Original PR: https://github.com/ytdl-org/youtube-dl/pull/29201
Authored by: mbway
2021-07-22 02:02:49 +05:30
pukkandan
7ea6541124
[youtube] Improve extraction of livestream metadata
Modified from and closes 
Authored by: pukkandan, krichbanana
2021-07-21 20:50:59 +05:30
pukkandan
ae30b84072
Add field live_status 2021-07-21 20:50:58 +05:30
Philip Xu
f6755419d1
[douyin] Add extractor ()
Authored-by: pukkandan, pyx
2021-07-21 20:49:27 +05:30
Henrik Heimbuerger
145bd631c5
[nebula] Authentication via tokens from cookie jar ()
Closes 
Co-authored-by: hheimbuerger, TpmKranz
2021-07-21 18:12:43 +05:30
pukkandan
352d63fdb5
[utils] Improve traverse_obj 2021-07-21 11:30:06 +05:30
pukkandan
11f9be0912
[youtube] Extract data from multiple clients ()
* `player_client` accepts multiple clients
* default `player_client` = `android,web`
* music clients can be specifically requested
* Add IOS `player_client`
* Hide live dash since they can't be downloaded

Closes 

Authored-by: pukkandan, colethedj
2021-07-21 09:22:34 +05:30
coletdjnz
a1a7907bc0
[youtube] Fix controversial videos when requested via API ()
Closes: https://github.com/yt-dlp/yt-dlp/issues/511#issuecomment-883024350
Authored by: colethedj
2021-07-20 23:31:28 +05:30
pukkandan
d61fc64618
[youtube:tab] Fix channels tab 2021-07-20 23:22:34 +05:30
pukkandan
da503b7a52
[youtube] Make parse_time_text and _extract_chapters non-fatal
Related: , 7c365c2109
2021-07-20 07:22:26 +05:30
pukkandan
7c365c2109
[youtube] Sanity check chapters (and refactor related code)
Closes 
2021-07-20 05:39:02 +05:30
pukkandan
cca80fe611 [youtube] Extract even more thumbnails and reduce testing
* Also fix bug where `_test_url` was being ignored

Ref: https://stackoverflow.com/a/20542029
Related: 
2021-07-20 03:46:06 +05:30
pukkandan
0ba692acc8
[youtube] Extract more thumbnails
* The thumbnail URLs are hard-coded and their actual existence is tested lazily
* Added option `--no-check-formats` to not test them

Closes , Related: , , https://github.com/ytdl-org/youtube-dl/issues/29049
2021-07-20 02:42:11 +05:30
pukkandan
d9488f69c1
[crunchyroll:playlist] Force http
Closes 
2021-07-20 02:42:11 +05:30
mzbaulhaque
8d9b902243
[pornflip] Add new extractor ()
Authored-by: mzbaulhaque
2021-07-19 23:46:21 +05:30
coletdjnz
fe93e2c4cf
[youtube] misc cleanup and bug fixes ()
* Update some `_extract_response` calls to keep them consistent
* Cleanup continuation extraction related code using new API format
* Improve `_extract_account_syncid` to support multiple parameters
* Generalize `get_text` and related functions into one
* Update `INNERTUBE_CONTEXT_CLIENT_NAME` with integer values

Authored by: colethedj
2021-07-19 10:25:07 +05:30
coletdjnz
314ee30548
[youtube] Fix session index extraction and headers for non-web player clients ()
Fixes 
2021-07-18 06:23:32 +00:00
coletdjnz
34917076ad
[youtube] Fix authentication when using multiple accounts
`SESSION_INDEX` in `ytcfg` is the index of the active account and should be sent as `X-Goog-AuthUser` header

Closes 
Authored by @colethedj
2021-07-17 11:50:05 +05:30
The Hatsune Daishi
ccc7795ca3
[yahoo:gyao:player] Relax _VALID_URL ()
Authored by: nao20010128nao
2021-07-16 20:06:53 +05:30
Felix S
da1c94ee45
[generic] Extract previously missed subtitles ()
* [generic] Extract subtitles in cases missed previously
* [common] Detect discarded subtitles in SMIL manifests
* [generic] Extract everything in the SMIL manifest

Authored by: fstirlitz
2021-07-16 19:52:56 +05:30
coletdjnz
47193e0298
[youtube:tab] Extract playlist availability ()
Authored by: colethedj
2021-07-15 02:42:30 +00:00
coletdjnz
49bd8c66d3
[youtube:comments] Improve comment vote count parsing (fixes ) ()
Authored by: colethedj
2021-07-14 23:24:42 +00:00
Felix S
182b6ae8a6
[RTP] Fix extraction and add subtitles ()
Authored by: fstirlitz
2021-07-14 05:06:18 +05:30
felix
198f7ea89e
[extractor] Allow extracting multiple groups in _search_regex
From , Authored by: fstirlitz
2021-07-14 05:02:42 +05:30
coletdjnz
c888ffb95a
[youtube] Use android client as default and add age-gate bypass for it ()
Authored by: colethedj
2021-07-14 03:58:51 +05:30
coletdjnz
9752433221
[youtube:comments] Fix is_favorited ()
Authored by colethedj
2021-07-12 06:50:03 +05:30
pukkandan
f0ff9979c6
[vlive] Extract thumbnail directly in addition to the one from Naver
Closes 
2021-07-12 06:07:23 +05:30
coletdjnz
2d6659b9ea
[youtube:comments] Move comment extraction to new API ()
Closes , ,  

Authored by: colethedj
2021-07-12 04:48:40 +05:30
Kevin O'Connor
c5370857b3
[BravoTV] Improve metadata extraction ()
Authored by: kevinoconnor7
2021-07-11 16:36:26 +05:30
pukkandan
6606817a86
[utils] Add variadic 2021-07-11 04:46:51 +05:30
zackmark29
73d829c144
[VIKI] Rewrite extractors ()
Closes 
Also added extractor-arg `video_types` to `vikichannel`

Co-authored-by: zackmark29, pukkandan
2021-07-10 02:08:09 +05:30
pukkandan
60bdb7bd9e
[youtube] Fix sorting of 3gp format 2021-07-08 22:33:33 +05:30
pukkandan
4bb6b02f93
Improve extractor_args parsing 2021-07-08 21:22:35 +05:30
pukkandan
51f8a31d65
Update to ytdl-commit-a803582
[peertube] only call description endpoint if necessary
a803582717
2021-07-07 05:17:11 +05:30
Tom-Oliver Heidel
be05d5cff1
[soundcloud] Allow login using oauth token ()
Authored by: blackjack4494
2021-07-07 04:21:13 +05:30
zenerdi0de
30d569d2ac
[fancode] Fix extraction, support live and allow login with refresh token ()
Authored-by: zenerdi0de
2021-07-07 04:02:56 +05:30
OhMyBahGosh
08625e4125
[AdobePass] Add Spectrum MSO ()
From: https://github.com/ytdl-org/youtube-dl/pull/26792

Co-authored by: kevinoconnor7, ohmybahgosh
2021-07-07 03:26:51 +05:30
pukkandan
3acf6d3856
[Funimation] Rewrite extractor (See desc) ()
* Support direct `/player/` URL
* Treat the different versions of an episode as different formats of a single video. So `experience_id` can no longer be used as the video `id` and the `episode_id` is used instead. This means that all existing archives will break
* Extractor options `language` and `version` to pre-select them
* Compat option `seperate-video-versions` to fall back to old behavior (including using the old video IDs)

Closes 
2021-07-07 02:51:29 +05:30
pukkandan
46890374f7
[extractor] Minor improvements (See desc)
1. Allow removal of login hint - extractors can set their own login hint as part of `msg`
2. Cleanup `_merge_subtitles` signature
2021-07-07 02:27:53 +05:30
pukkandan
60755938b3
[extractor] Prevent unnecessary download of hls manifests
and refactor `hls_split_discontinuity` code
2021-07-07 02:24:58 +05:30
pukkandan
bc97cdae67
[cleanup] Fix linter and some typos
Related: https://github.com/ytdl-org/youtube-dl/pull/29398
2021-07-04 03:04:25 +05:30
nyuszika7h
e010672ab5
[videa] Fix extraction ()
Authored by: nyuszika7h
2021-07-03 21:38:08 +05:30
MinePlayersPE
17f0eb66b8
[RCTIPlus] Add extractor ()
Authored by: MinePlayersPE
2021-07-02 19:54:41 +05:30
pukkandan
b1e60d1806 [facebook] Extract description and fix title
Partially fixes: 
2021-07-02 08:17:37 +05:30
krichbanana
f6745c4980
[Youtube] Choose correct Live chat API for upcoming streams ()
Authored by: krichbanana
2021-07-02 05:59:29 +05:30
coletdjnz
109dd3b237
[youtube] Use new API for additional video extraction requests ()
Co-authored-by: colethedj, pukkandan
Closes https://github.com/yt-dlp/yt-dlp/issues/427
Workarounds for https://github.com/ytdl-org/youtube-dl/issues/29326, https://github.com/yt-dlp/yt-dlp/issues/319, https://github.com/ytdl-org/youtube-dl/issues/29086
2021-06-29 22:07:49 +00:00
LE
1e79316e20
[TBS] Support livestreams ()
Authored by: llacb47
2021-06-26 17:14:43 +05:30
coletdjnz
45261e063b
[youtube:comments] Fix error handling and add itct to params ()
Should close  (untested)

Authored by: colethedj
2021-06-25 23:31:10 +05:30
pukkandan
49c258e18d
[youtube] Fix subtitle names for age-gated videos
Related: https://github.com/iv-org/invidious/pull/2205#issuecomment-868680486
2021-06-25 23:10:31 +05:30
pukkandan
5d3a0e794b
Add --extractor-args to pass extractor-specific arguments 2021-06-25 20:10:28 +05:30
Mevious
125728b038
[funimation] Add FunimationShowIE ()
Closes 

Authored by: Mevious
2021-06-25 05:45:23 +05:30
LE
412cce82b0
[yahoo] Fix extraction ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/28290

Co-authored-by: llacb47, pukkandan
2021-06-24 21:27:48 +05:30
pukkandan
2b18a8c590
[plutotv] Improve _VALID_URL
Closes 
2021-06-23 07:49:09 +05:30
pukkandan
ed807c1837
Update to ytdl-commit-379f52a
[liveleak] Remove extractor
379f52a495
2021-06-23 07:34:55 +05:30
Mevious
29f63c9672
[funimation] Extract subtitles ()
Closes , https://github.com/ytdl-org/youtube-dl/issues/25645
Related: https://github.com/ytdl-org/youtube-dl/pull/24906

Authored by: Mevious
2021-06-23 07:27:53 +05:30
pukkandan
9fc0de5796
[hotstar] Use server time for authentication instead of local time
Closes 
2021-06-23 06:04:42 +05:30
siikamiika
c60ee3a218
[youtube_live_chat] Support ongoing live chat ()
Authored by: siikamiika
2021-06-23 05:42:39 +05:30
pukkandan
e6779b9400
[twitcasting] Websocket support ()
Closes 
Authored by: nao20010128nao
2021-06-21 22:56:45 +05:30
pukkandan
e36d50c5dd
[websockets] Add WebSocketFragmentFD ()
Necessary for 

Co-authored by: nao20010128nao, pukkandan
2021-06-21 22:56:36 +05:30
pukkandan
4e6767b5f2
[youtube] Temporary fix for age-gate
Related:
https://stackoverflow.com/a/67629882
https://github.com/yt-dlp/yt-dlp/issues/319
https://github.com/ytdl-org/youtube-dl/issues/29333
https://github.com/ytdl-org/youtube-dl/issues/29086
2021-06-18 20:32:52 +05:30
pukkandan
d0fb4bd16f
[pornhub] Extract cast
Closes , https://github.com/ytdl-org/youtube-dl/pull/27384
2021-06-13 21:38:08 +05:30
felix
3fd4c2a543
[mediasite] Extract slides ()
Fixes:
https://github.com/ytdl-org/youtube-dl/issues/4974#issue-58006762
https://github.com/ytdl-org/youtube-dl/issues/4540#issuecomment-69574231
https://github.com/ytdl-org/youtube-dl/pull/11185#issuecomment-335554239

Authored by: fstirlitz
2021-06-13 20:36:40 +05:30
felix
cdb19aa4c2
[downloader/mhtml] Add new downloader ()
This downloader is intended to be used for streams that consist of a
timed sequence of stand-alone images, such as slideshows or thumbnail
streams

This can be used for implementing:

https://github.com/ytdl-org/youtube-dl/issues/4974#issue-58006762
https://github.com/ytdl-org/youtube-dl/issues/4540#issuecomment-69574231
https://github.com/ytdl-org/youtube-dl/pull/11185#issuecomment-335554239

https://github.com/ytdl-org/youtube-dl/issues/9868
https://github.com/ytdl-org/youtube-dl/pull/14951


Authored by: fstirlitz
2021-06-13 20:36:40 +05:30
pukkandan
8326b00aab
Allow images formats
Necessary for .

* They are identified by `vcodec=acodec='none'`
* These formats show as the worst in `-F`
* Any postprocessor that expects audio/video will be skipped
* `b*` and all related selectors will skip such formats
* This commit also does not add any selector for downloading such formats. They have to be explicitly requested by the `format_id`. Implementation of a selector is left for when  is resolved
2021-06-13 03:45:53 +05:30
pukkandan
45db527fa6
[youtube] Login is not needed for :ytrec 2021-06-13 03:45:53 +05:30
coletdjnz
4ba001080f
[youtube] Non-fatal alert reporting for unavailable videos page ()
Co-Authored by: colethedj, pukkandan
2021-06-10 21:12:56 +00:00
coletdjnz
1974e99f4b
[youtube] Improve SAPISID cookie handling (closes ) ()
Author: colethedj
2021-06-10 21:02:57 +00:00
pukkandan
3b1fe47d84
Release 2021.06.08 2021-06-08 20:13:41 +05:30
pukkandan
46358f647d
Update to ytdl-commit-c2350ca
Update MSVC 2010 redist URL
c2350cac24
2021-06-08 00:28:32 +05:30
pukkandan
89ee4cf8ae
[viki] Fix extraction
Closes 
Code from: 59e583f7e8
2021-06-07 12:42:58 +05:30
pukkandan
eb0f9d6838
[zoom] Extract transcripts as subtitles 2021-06-06 17:09:09 +05:30
pukkandan
d3d8d8184a
[extractor] Fix pre-checking archive for some extractors
The `id` regex group must be present for `_match_id` and pre-checking archive to work correctly
2021-06-06 15:05:07 +05:30
pukkandan
e85a39717a
[twitcasting] Add TwitCastingUserIE, TwitCastingLiveIE
Closes 

Code adapted from: f1fb9222bb/youtube_dl/extractor/twitcasting.py
Authored by: pukkandan, nao20010128nao
2021-06-06 03:26:33 +05:30
MinePlayersPE
f2cd7060fc
[vidio] Add VidioPremierIE and VidioLiveIE ()
Authored-by: MinePlayersPE
2021-06-06 01:25:26 +05:30
felix
e2efe599aa
[common] Fix FourCC fallback when parsing ISM ()
In some DASH manifests, the FourCC attribute is actually present,
but empty.  We thus apply the same fallback to 'AACL' that we do
when the attribute is entirely absent.

Authored by: fstirlitz
2021-06-06 00:59:04 +05:30
pukkandan
5e1dba8ed6
Remove duplicate file trovolive.py 2021-06-06 00:59:04 +05:30
pukkandan
bea742222f
[youtube] Support shorts URL
Closes 
2021-06-06 00:59:04 +05:30
Ashish
6e6390321c
[Hotstar] Add HotStarSeriesIE ()
Authored by: Ashish0804
2021-06-01 20:14:03 +05:30
pukkandan
14eb1ee1cb
Update to ytdl-commit-d495292
[ard] Relax _VALID_URL and fix video ids
d495292852

Closes 
2021-06-01 02:48:20 +05:30
coletdjnz
879e7199bb
[archiveorg] Add YoutubeWebArchiveIE ()
Co-authored by: colethedj, pukkandan, alex-gedeon
2021-05-31 01:12:38 +00:00
MinePlayersPE
10bb7e51e8
[vidio] Add login support ()
Authored by: MinePlayersPE
2021-05-30 20:19:14 +05:30
pukkandan
b0089e8992
[fancode] Add extractor (#316,#354)
Closes , 

Authored by: rmsmachine
2021-05-30 19:34:39 +05:30
Ashish
a3ed14cbaf
[Voot] Add VootSeriesIE ()
Authored by: Ashish0804
2021-05-30 16:45:42 +05:30
LE
9dee4df559
[Saitosan] Add new extractor ()
Closes 
Authored by: llacb47
2021-05-30 14:32:18 +05:30
pukkandan
adddc50cbf
[extractor] Functions to parse socket.io response as json
Authored by: pukkandan, llacb47
2021-05-30 14:22:42 +05:30
MinePlayersPE
46c43ffc9d
[vidio] Support premium videos ()
Authored by: MinePlayersPE
2021-05-29 20:24:19 +05:30
pukkandan
37a3bb66a7
[extractor] Allow note=False when extracting manifests 2021-05-29 14:22:44 +05:30
pukkandan
46953e7e6e
[youtube:playlist] fix bug 2021-05-29 02:31:13 +05:30
pukkandan
077c476276
[zee5] Fix m3u8 formats extension 2021-05-29 02:31:12 +05:30
rhsmachine
65af1839c6
[patreon] Support vimeo embeds ()
Authored by: rhsmachine
2021-05-27 22:14:43 +05:30
pukkandan
177877c544
[extractor] Always prefer native hls downloader by default
When the manifest is not downloadable by native downloader, it already is able to detect it and switch to `ffmpeg`. So there doesn't seem to be a reason anymore to use ffmpeg as the preferred downloader
2021-05-26 01:27:39 +05:30
Oliver Freyermuth
f17c702270
[ard] Allow URLs without - before id
https://github.com/ytdl-org/youtube-dl/pull/29091

Authored by: olifre
2021-05-23 23:03:08 +05:30
pukkandan
3907333c5d
[extractor] Skip subtitles without URI in m3u8 manifests
Closes 

Authored by: hheimbuerger
2021-05-23 22:32:47 +05:30
Ashish
09d18ad07e
[Sonyliv] Add subtitle support ()
Authored by: Ashish0804
2021-05-23 21:26:27 +05:30
Ashish
9572eaaa11
[ShemarooMe] Add extractor ()
Closes 
Co-authored-by: Ashish0804, pukkandan
2021-05-23 12:42:50 +05:30
pukkandan
8d68ab98a7
[youtube] Fix bug where not all hls formats were extracted
Bug introduced in 9297939ec3
2021-05-23 03:53:17 +05:30
Ashish
135e6b93f4
[SonyLIV] Add SonyLIVSeriesIE ()
Authored by: Ashish0804
2021-05-22 17:53:06 +05:30
king-millez
13a49340ed
[telemundo] add extractor ()
Closes 
Authored by: king-millez
2021-05-22 17:17:49 +05:30
pukkandan
09f1580e2d
[youtube] /live URLs should raise error if channel is not live
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29090
2021-05-21 20:05:54 +05:30
pukkandan
b73612a254
Update to ytdl-commit-dfbbe29
[redbulltv] fix embed data extraction
dfbbe2902f
2021-05-20 21:13:18 +05:30
king-millez
5014558ab9
[parlview] Add extractor ()
Authored by: king-millez
2021-05-20 18:35:37 +05:30
coletdjnz
00ae27690d
[youtube] Add html5=1 param to get_video_info page requests ()
Workaround for , https://github.com/ytdl-org/youtube-dl/issues/29086
Authored by: colethedj
2021-05-20 15:56:57 +05:30
pukkandan
9d5d4d64f8
[youtube] Better message when login required 2021-05-20 15:55:55 +05:30
king-millez
98784ef8d6
[audius:artist] Add extractor ()
Authored by: king-millez
2021-05-20 15:55:55 +05:30
pukkandan
d3fc8074a4
[youtube] Sort audio-only formats correctly
Closes 
2021-05-19 18:29:20 +05:30
pukkandan
07cce701de
[cleanup] linter, code formatting and readme 2021-05-19 16:48:20 +05:30
king-millez
74e001af1d
[tenplay] Fix extractor ()
Authored by: king-millez
2021-05-19 16:43:34 +05:30
pukkandan
ff2751ac9c
[youtube] Always extract maxresdefault thumbnail
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29049
2021-05-18 19:31:17 +05:30
pukkandan
abcdd12b26
[youtube:tab] Support youtube music MP pages 2021-05-18 19:31:08 +05:30
pukkandan
18db754858
[youtube:tab] Redirect UC channels that doesn't have a videos tab
Many topic URLs don't have a videos tab, but has an equivalent `UU` playlist.
If there is no playlist, fallback to using channel page
2021-05-18 19:31:07 +05:30
pukkandan
fe03a6cdc8
[youtube:tab] Support youtube music VL and browse pages 2021-05-18 19:31:06 +05:30
pukkandan
cd684175ad
[youtube:tab] Support channel search
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29071
2021-05-18 19:30:21 +05:30
pukkandan
da692b7920
[cleanup] youtube tests 2021-05-18 18:10:15 +05:30
pukkandan
95c01b6c16
[youtube:tab] Show alerts only from the final webpage 2021-05-18 18:09:04 +05:30
pukkandan
a06916d98e
[extractor] Add write_debug and get_param 2021-05-17 18:59:51 +05:30
coletdjnz
9297939ec3
[Youtube] Extract more formats for music.youtube URLs ()
Based on: https://github.com/ytdl-org/youtube-dl/pull/28778, https://github.com/ytdl-org/youtube-dl/pull/26160

Co-authored-by: craftingmod, colethedj, pukkandan
2021-05-15 20:08:47 +05:30
pukkandan
774d79cc4c
[youtube] Add language names
Co-authored by: nixxo, tpikonen
Based on: https://github.com/ytdl-org/youtube-dl/pull/26112
Closes: 
2021-05-15 19:27:53 +05:30
pukkandan
2412044c90
Add field name for subtitles
Co-authored by: pukkandan, tpikonen

Based on: , https://github.com/ytdl-org/youtube-dl/pull/26112
2021-05-15 19:27:52 +05:30
pukkandan
120916dac2
[youtube] multiple subtitles in same language
Fixes: https://github.com/ytdl-org/youtube-dl/issues/21164
Related: , https://github.com/ytdl-org/youtube-dl/pull/26112
2021-05-15 19:27:48 +05:30
pukkandan
0fb983f62d
[youtube] Extract audio language 2021-05-14 13:15:48 +05:30
pukkandan
0760b0a7e2
Standardize write_debug 2021-05-14 13:15:29 +05:30
pukkandan
d908aa636a
[cleanup] Fix typos 2021-05-11 23:34:40 +05:30
pukkandan
3d89341b47
[common] bugfix for when compat_opts is not given 2021-05-11 23:29:26 +05:30
pukkandan
d8ec40b39f
[rmcdecouverte] Generalize _VALID_URL
Closes 
2021-05-11 18:57:55 +05:30
pukkandan
fac988053f
Release 2021.05.11
* and some documentation improvements
2021-05-11 13:35:05 +05:30
pukkandan
61241abbb0
[generic] Respect the encoding in manifest 2021-05-11 13:32:03 +05:30
pukkandan
53ed7066ab
Option --compat-options to revert some of yt-dlp's changes
* Deprecates `--list-formats-as-table`, `--list-formats-old`
2021-05-11 13:30:48 +05:30
pukkandan
2f567473c6
[Plugins] Prioritize plugins over standard extractors
and prevent plugins from overwriting the standard extractor classes

Closes 
2021-05-09 04:22:27 +05:30
pukkandan
41d1cca328
Update to ytdl-commit-a726009
[blinkx] Remove extractor
a726009987
2021-05-06 21:31:20 +05:30
pukkandan
12e73423f1
[plutotv] Fix format extraction for some urls
* And fallback to the first urls if ad-free urls can't be found
Closes 
2021-05-06 20:28:57 +05:30
pukkandan
7700b37f39
[plutotv] Extract subtitles from manifests 2021-05-06 20:28:56 +05:30
Ashish
c28cfda81f
[SonyLiv] Fix title and series extraction ()
Authored by: Ashish0804
2021-05-06 20:27:43 +05:30
pukkandan
3158150cb7
[utils] Add network_exceptions 2021-05-04 22:36:18 +05:30
pukkandan
06425e9621
[blinkx] Minor fix
Fixes: https://github.com/ytdl-org/youtube-dl/issues/28941
2021-05-04 22:27:44 +05:30
pukkandan
1815d1028b
[zee5] Fix py2 compatibility 2021-05-03 22:49:03 +05:30
The Hatsune Daishi
0fa9a1e236
[whowatch] Add extractor
closes 

Authored by: nao20010128nao 
Modified from: 9e4a0e061a/youtube_dl/extractor/whowatch.py
2021-05-02 19:43:37 +05:30
pukkandan
80185155a1
[ukcolumn] Add Extractor
Closes 
2021-05-02 13:57:50 +05:30
pukkandan
c755f1901f
[CBS] Improve _VALID_URL to support movies
Closes 
Tested by: BeeMuffins
2021-05-01 21:32:14 +05:30
pukkandan
68b91dc905
[youtube] Add oembed to reserved names 2021-05-01 21:24:31 +05:30
pukkandan
88f06afc0c
[rmcdecouverte] Improve _VALID_URL
Closes 
2021-05-01 21:24:31 +05:30
CXwudi
40078a55e2
[niconico] Fix bug in thumbnail extraction
Bug from: 6b1d8c1e30
Authored by: CXwudi
2021-05-01 19:35:47 +05:30
pukkandan
07e4a40a9a
[crackle] Improve extraction (See desc)
Closes 

* Refactor authorization as an extension to `_download_json`
* Better error messages and warnings
* Respect `--ignore-no-formats-error`
* Extract subtitles from manifests
* Try with crackle's geo-location service if all hard-coded countries fail
2021-04-29 05:20:16 +05:30
pukkandan
e28f1c0ae8
[cleanup] Fix linter and some typos
* Also remove inconsistent use of `"` in setup.py
2021-04-28 19:59:40 +05:30
pukkandan
ef39f8600a
[curiositystream] Fix collections
Closes 

* A bug with authentication was reported in <https://github.com/yt-dlp/yt-dlp/issues/277#issuecomment-828254721> but cannot be tested without an account
2021-04-28 19:29:33 +05:30
pukkandan
2291dbce2a
[niconico] Fix HLS formats
Closes 

* The structure of the API JSON was changed
* Smile Video seems to be no longer available. So remove the warning
* Move ping to downloader
* Change heartbeat interval to 40sec
* Remove unnecessary API headers

Authored-by: CXwudi, tsukumijima, nao20010128nao, pukkandan
Tested by: tsukumijima
2021-04-28 19:18:29 +05:30
pukkandan
895b0931e5
[youtube:tab] Detect playlists inside community posts 2021-04-28 19:18:06 +05:30
pukkandan
1ad047d0f7
[nebula] Move to nebula.app
Closes 
Tested by: Lamieur
2021-04-28 19:18:06 +05:30
pukkandan
be6202f12b
Subtitle extraction from streaming media manifests
Authored by fstirlitz
Modified from: https://github.com/ytdl-org/youtube-dl/pull/6144

Closes: 
Fixes:
https://github.com/ytdl-org/youtube-dl/issues/6106
https://github.com/ytdl-org/youtube-dl/issues/14977
https://github.com/ytdl-org/youtube-dl/issues/21438
https://github.com/ytdl-org/youtube-dl/issues/23609
https://github.com/ytdl-org/youtube-dl/issues/28132

Might also fix (untested):
https://github.com/ytdl-org/youtube-dl/issues/15424
https://github.com/ytdl-org/youtube-dl/issues/18267
https://github.com/ytdl-org/youtube-dl/issues/23899
https://github.com/ytdl-org/youtube-dl/issues/24375
https://github.com/ytdl-org/youtube-dl/issues/24595
https://github.com/ytdl-org/youtube-dl/issues/27899

Related:
https://github.com/ytdl-org/youtube-dl/issues/22379
https://github.com/ytdl-org/youtube-dl/pull/24517
https://github.com/ytdl-org/youtube-dl/pull/24886
https://github.com/ytdl-org/youtube-dl/pull/27215

Notes:
* The functions `extractor.common._extract_..._formats` are still kept for compatibility
* Only some extractors have currently been moved to using `_extract_..._formats_and_subtitles`
* Direct subtitle manifests (without a master) are not supported and are wrongly identified as containing video formats
* AES support is untested
* The fragmented TTML subtitles extracted from DASH/ISM are valid, but are unsupported by `ffmpeg` and most video players
    * Their XML fragments can be dumped using `ffmpeg -i in.mp4 -f data -map 0 -c copy out.ttml`.
        Once the unnecessary headers are stripped out of this, it becomes a valid self-contained ttml file
    * The ttml subs downloaded from DASH manifests can also be directly opened with <https://github.com/SubtitleEdit>
* Fragmented WebVTT files extracted from DASH/ISM are also unsupported by most tools
    * Unlike the ttml files, the XML fragments of these cannot be dumped using `ffmpeg`
    * The webtt subs extracted from DASH can be parsed by <https://github.com/gpac/gpac>
    * But validity of the those extracted from ISM are untested
2021-04-28 19:02:43 +05:30
Felix S
e8f834cd8d [threeqsdn] Extract subtitles from streaming manifests 2021-04-28 17:24:50 +05:30
Felix S
e0e624ca7f [canvas] Extract subtitles from streaming manifests 2021-04-28 17:24:19 +05:30
Felix S
ec4f374c05 [wat] Extract subtitles from streaming manifests 2021-04-28 17:24:08 +05:30
Felix S
c811e8d8bd [atresplayer] Extract subtitles from streaming manifests 2021-04-28 17:23:56 +05:30
Felix S
b2cd5da460 [francetv] Extract subtitles from the HLS manifest 2021-04-28 17:23:47 +05:30
Felix S
2de3b21e05 [uplynk] Extract subtitles from HLS manifests 2021-04-28 17:23:37 +05:30
Felix S
4bed436371 [twitter] Extract subtitles from HLS manifests 2021-04-28 17:23:27 +05:30
Felix S
efe9dba595 [srgssr] Extract subtitles from HLS manifests 2021-04-28 17:23:16 +05:30
Felix S
47f4203dd3 [nytimes] Extract subtitles from HLS manifests 2021-04-28 17:23:05 +05:30
Felix S
015c10aeec [roosterteeth] Use common code for subtitle extraction 2021-04-28 17:22:56 +05:30
Felix S
a00d781b73 [elonet] Use common code for subtitle extraction 2021-04-28 17:22:45 +05:30
Felix S
0c541b563f [tv4] Extract subtitles from streaming manifests 2021-04-28 17:22:36 +05:30
Felix S
64a5cf7929 [byutv] Extract subtitles from streaming manifests 2021-04-28 17:22:27 +05:30
Felix S
7a450a3b1c [generic] Extract subtitles from direct SSTR manifest links 2021-04-28 17:22:18 +05:30
Felix S
7de27caf16 [generic] Extract subtitles from direct DASH manifest links 2021-04-28 17:22:07 +05:30
Felix S
c26326c1be [generic] Extract subtitles from direct HLS manifest links 2021-04-28 17:21:55 +05:30
Felix S
66a1b8643a [downloader/ism] Support muxing TTML subtitles 2021-04-28 17:21:45 +05:30
Felix S
4a2f19abbd [downloader/hls] Assemble single-file WebVTT subtitles from HLS segments 2021-04-28 17:21:14 +05:30
Felix S
f6a1d69a87 [extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks 2021-04-28 17:20:29 +05:30
Felix S
fd76a14259 [extractor/common, downloader/ism] Extract SSTR subtitle tracks
_parse_ism_formats was extended into _parse_ism_formats_and_subtitles;
all direct users were updated, though _extract_ism_formats was left
as a compatibility wrapper.

The SSTR downloader was also modified in order to prepare for muxing
subtitle streams, although no support for any subtitle codecs was
added in this commit.
2021-04-28 17:20:20 +05:30
Felix S
171e59edd4 [extractor/common] Extract DASH subtitle tracks
_extract_mpd_formats and _parse_mpd_formats were extended into
_…_formats_and_subtitles; wrappers with old names are provided
for compatibility.
2021-04-28 17:20:11 +05:30
Felix S
a0c3b2d5cf [extractor/common] Extract HLS subtitle tracks
_extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles
and extended to handle subtitle tracks instead of skipping them;
a wrapper with the old name is provided for compatibility.

_parse_m3u8_formats is likewise renamed and extended, but without adding
the compatibility wrapper; the test suite is adjusted to test the enhanced
method instead.
2021-04-28 17:19:57 +05:30
Felix S
19bb39202d [extractor/common] Generalise _merge_subtitles
This allows modifying a subtitles dictionary in-place.
2021-04-28 17:19:46 +05:30
Hadi0609
db9a564b6a
[zee5] Fix extraction for some URLs ()
Closes: 
2021-04-28 14:51:54 +05:30
Felix S
c72967d5de
[mediasite] Generalize URL pattern ()
Authored by: fstirlitz
2021-04-26 17:23:20 +05:30
pukkandan
b982cbdd0e
[limelight] Obey allow_unplayable_formats 2021-04-26 10:56:55 +05:30
pukkandan
6a04a74e8b
[FormatSort] Fix for when some formats have quality and others don't 2021-04-26 10:56:54 +05:30
CXwudi
6b1d8c1e30
[niconico] Fix title and thumbnail extraction ()
Authored by: CXwudi
2021-04-26 08:23:57 +05:30
Ashish
87c3d06271
[Mxplayer] Add MxplayerShowIE ()
Authored by: Ashish0804
2021-04-26 08:12:51 +05:30
pukkandan
cf9d6cfb0c
[tubi] Raise "no video formats" error when video url is empty
Related: 
2021-04-24 17:52:33 +05:30
pukkandan
bbed5763f1
[francetvinfo] Improve video id extraction
Closes 
2021-04-23 00:01:09 +05:30
pukkandan
1bdae7d312
Update to ytdl-commit-7e8b3f9
[youtube] Remove unused code
7e8b3f9439
2021-04-22 16:54:07 +05:30
Felix S
a471f21da6
[mildom] Remove proxy ()
Closes 
Makes 2cff495997, ab406a1c0e,  obsolete

Authored by: fstirlitz
2021-04-22 16:52:22 +05:30
pukkandan
6efb071135
[BilibiliChannel] Fix pagination
Closes 

ccca21d7f5
Coauthored by: nao20010128nao, pukkandan
2021-04-22 04:19:33 +05:30
pukkandan
3b4775e021
[go] Fix _VALID_URL
Closes 
2021-04-21 15:43:53 +05:30
pukkandan
ab406a1c0e
[mildom] Warn user of proxy 2021-04-21 15:43:22 +05:30
pukkandan
8c54a3051d
[youtube] Bugfix in _extract_ytcfg 2021-04-21 10:37:24 +05:30
pukkandan
3097d9e512
[mildom:user:vod] Download only necessary amount of pages 2021-04-19 11:41:49 +05:30
pukkandan
c1df120eda
[mildom:vod] Remove proxy
* Proxy is needed only for live videos
2021-04-19 11:41:40 +05:30
pukkandan
2cff495997
[mildom] Change proxy
Related: 
Closes 
2021-04-19 11:41:33 +05:30
pukkandan
d0491a1ebe
[twitcasting] Fix extractor
* `Origin: https://twitcasting.tv` must be sent when requesting the webpage. Otherwise the extracted `m3u8` will always give a `502`
* Fix regex for when `data-movie-playlist` is a dict containing the needed list
* media initialization is fully supported; so change downloader to native

Closes 
2021-04-18 17:57:46 +05:30
nixxo
b9d68c199b
[rai] Add support for http formats ()
Authored by: nixxo
2021-04-17 22:42:28 +05:30
pukkandan
201c145953
Update to ytdl-commit-9f6c03
[cbsnews] Fix extraction for python <3.6
9f6c03a006
2021-04-17 08:40:31 +05:30
pukkandan
5d34200268
[youtube:tab] Reload with unavailable videos for all playlists
If the unavailable video is in a later page, the warning and button are not shown in the initial webpage
So we force all playlists' initial page to reload with the correct params
2021-04-17 08:40:30 +05:30