534 Commits

Author	SHA1	Message	Date
pukkandan	adddc50cbf	[extractor] Functions to parse socket.io response as json ... Authored by: pukkandan, llacb47	2021-05-30 14:22:42 +05:30
MinePlayersPE	46c43ffc9d	[vidio] Support premium videos (#358) ... Authored by: MinePlayersPE	2021-05-29 20:24:19 +05:30
pukkandan	37a3bb66a7	[extractor] Allow note=False when extracting manifests	2021-05-29 14:22:44 +05:30
pukkandan	337e0c62f8	[embedthumbnail] Correctly escape filename ... Closes #352 The approach in [1] is faulty as can be seen in the test cases 1. bff857a8af	2021-05-29 02:31:14 +05:30
pukkandan	885cc0b75c	[embedthumbnail] Embed if any thumbnail was downloaded, not just the best	2021-05-29 02:31:14 +05:30
pukkandan	46953e7e6e	[youtube:playlist] fix bug	2021-05-29 02:31:13 +05:30
pukkandan	ae8f99e648	Remove None values from info.json	2021-05-29 02:31:13 +05:30
pukkandan	077c476276	[zee5] Fix m3u8 formats extension	2021-05-29 02:31:12 +05:30
pukkandan	835a1478b4	Write messages to stderr when both quiet and verbose	2021-05-29 02:31:10 +05:30
pukkandan	120fe5134a	Pre-check archive and filters during playlist extraction ... This makes `--break-on-existing` much faster. It also helps `--break-on-reject` if the playlist extractor can extract the relevant fields	2021-05-29 02:12:09 +05:30
pukkandan	56a8fb4f77	Refactor __process_playlist using LazyList	2021-05-29 02:12:09 +05:30
pukkandan	55575225b4	[utils] Add __getitem__ for PagedList	2021-05-29 02:12:08 +05:30
pukkandan	483336e79e	[utils] Add LazyList	2021-05-29 02:12:08 +05:30
pukkandan	c77495e3a4	[cleanup] _match_entry	2021-05-29 02:12:07 +05:30
rhsmachine	65af1839c6	[patreon] Support vimeo embeds (#349) ... Authored by: rhsmachine	2021-05-27 22:14:43 +05:30
pukkandan	177877c544	[extractor] Always prefer native hls downloader by default ... When the manifest is not downloadable by native downloader, it already is able to detect it and switch to `ffmpeg`. So there doesn't seem to be a reason anymore to use ffmpeg as the preferred downloader	2021-05-26 01:27:39 +05:30
pukkandan	b25522ba52	[update] Replace self without launching a subprocess in windows ... Closes: #335, https://github.com/ytdl-org/youtube-dl/issues/28488, https://github.com/ytdl-org/youtube-dl/issues/5810, https://github.com/ytdl-org/youtube-dl/issues/5994 In windows, a running executable cannot be replaced. So, the old updater worked by launching a batch script and then exiting, so that the batch script can replace the executable. However, this caused the above-mentioned issues. The new method takes advantage of the fact that while the executable cannot be replaced or deleted, it can still be renamed. The current update process on windows is as follows: 1. Delete `yt-dlp.exe.old` if it exists 2. Download the new version as `yt-dlp.exe.new` 3. Rename the running exe to `yt-dlp.exe.old` 4. Rename `yt-dlp.exe.new` to `yt-dlp.exe` 5. Open a shell that deletes `yt-dlp.exe.old` and terminate While we still use a subprocess, the actual update is already done before the app terminates and the batch script does not print anything to stdout/stderr. So this solves all the above issues	2021-05-26 01:13:34 +05:30
pukkandan	c19bc311cb	[cleanup] Refactor updater ... The updater now uses `.update.run_update` and not `.update.update_self`. Although I don't expect anyone to be using the updater via API, a wrapper `update_self` is provided for compatibility just in case	2021-05-26 01:13:08 +05:30
Hubert Hirtz	5435dcf96e	Handle Basic Auth user:pass in URLs ... Fixes https://github.com/ytdl-org/youtube-dl/issues/20258, https://github.com/ytdl-org/youtube-dl/issues/26211 Authored by: hhirtz, pukkandan	2021-05-24 03:38:02 +05:30
Oliver Freyermuth	f17c702270	[ard] Allow URLs without - before id ... https://github.com/ytdl-org/youtube-dl/pull/29091 Authored by: olifre	2021-05-23 23:03:08 +05:30
pukkandan	3907333c5d	[extractor] Skip subtitles without URI in m3u8 manifests ... Closes #339 Authored by: hheimbuerger	2021-05-23 22:32:47 +05:30
pukkandan	acdecdfaef	[embedthumbnail] Embed in mp4/m4a using mutagen ... Code from: https://github.com/ytdl-org/youtube-dl/pull/23525 Co-authored by: tripulse , pukkandan	2021-05-23 22:16:35 +05:30
Ashish	09d18ad07e	[Sonyliv] Add subtitle support (#342) ... Authored by: Ashish0804	2021-05-23 21:26:27 +05:30
pukkandan	bc516a3f3c	Sanitize and sort playlist thumbnails ... Closes #341	2021-05-23 17:28:15 +05:30
Ashish	9572eaaa11	[ShemarooMe] Add extractor (#332) ... Closes #307 Co-authored-by: Ashish0804, pukkandan	2021-05-23 12:42:50 +05:30
pukkandan	18e674b4f6	[ffmpeg] Download and merge in a single step if possible	2021-05-23 03:53:18 +05:30
pukkandan	8d68ab98a7	[youtube] Fix bug where not all hls formats were extracted ... Bug introduced in 9297939ec3	2021-05-23 03:53:17 +05:30
Ashish	135e6b93f4	[SonyLIV] Add SonyLIVSeriesIE (#331) ... Authored by: Ashish0804	2021-05-22 17:53:06 +05:30
king-millez	13a49340ed	[telemundo] add extractor (#327) ... Closes #284 Authored by: king-millez	2021-05-22 17:17:49 +05:30
pukkandan	81a23040eb	[cleanup] Refactor ffmpeg convertors	2021-05-22 15:20:42 +05:30
pukkandan	857f63136d	[videoconvertor] Generalize with remuxer and allow conditional recoding	2021-05-22 15:20:42 +05:30
louie-github	a927acb1ec	[ThumbnailsConvertor] Support conversion to png and make it the default (#333) ... PNG, being a lossless format, should be a better default here compared to JPG since we won't be compressing to a lossy format and losing some of the original image data PNG is also supported for embedding in all the formats similar to JPEG Authored by: louie-github	2021-05-21 23:39:48 +05:30
pukkandan	09f1580e2d	[youtube] /live URLs should raise error if channel is not live ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/29090	2021-05-21 20:05:54 +05:30
pukkandan	cd59e22191	[version] update ... :ci skip all	2021-05-20 21:15:41 +05:30
pukkandan	b73612a254	Update to ytdl-commit-dfbbe29 ... [redbulltv] fix embed data extraction dfbbe2902f	2021-05-20 21:13:18 +05:30
king-millez	5014558ab9	[parlview] Add extractor (#322) ... Authored by: king-millez	2021-05-20 18:35:37 +05:30
pukkandan	28b0eb0f65	[cleanup] See desc ... * Remove struct from `embedthumbnail` * Use bullet lists in readme where numbered list don't make sense * Fix error introduced in 9c2b75b561 when `ie_result` is `None`	2021-05-20 18:02:58 +05:30
pukkandan	95131b2176	[embedthumbnail] Add flac support and refactor mutagen code ... https://github.com/ytdl-org/youtube-dl/pull/28894, https://github.com/ytdl-org/youtube-dl/pull/24310 Authored by: tripulse	2021-05-20 17:51:33 +05:30
pukkandan	2305e2e5c9	[options] Alias --write-comments, --no-write-comments ... Closes: #264	2021-05-20 15:56:57 +05:30
coletdjnz	00ae27690d	[youtube] Add html5=1 param to get_video_info page requests (#329) ... Workaround for #319, https://github.com/ytdl-org/youtube-dl/issues/29086 Authored by: colethedj	2021-05-20 15:56:57 +05:30
pukkandan	9d5d4d64f8	[youtube] Better message when login required	2021-05-20 15:55:55 +05:30
king-millez	98784ef8d6	[audius:artist] Add extractor (#323) ... Authored by: king-millez	2021-05-20 15:55:55 +05:30
pukkandan	d3fc8074a4	[youtube] Sort audio-only formats correctly ... Closes #317	2021-05-19 18:29:20 +05:30
pukkandan	9c2b75b561	Field additional_urls to download additional videos from metadata	2021-05-19 18:11:15 +05:30
pukkandan	856bb8f99d	[downloader] Fix write_debug	2021-05-19 17:34:17 +05:30
pukkandan	4ec82a72bb	Ensure post_extract and pre_process only run once ... Previously, they ran once for each format requested	2021-05-19 16:48:22 +05:30
pukkandan	07cce701de	[cleanup] linter, code formatting and readme	2021-05-19 16:48:20 +05:30
king-millez	74e001af1d	[tenplay] Fix extractor (#314) ... Authored by: king-millez	2021-05-19 16:43:34 +05:30
pukkandan	ff2751ac9c	[youtube] Always extract maxresdefault thumbnail ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/29049	2021-05-18 19:31:17 +05:30
pukkandan	abcdd12b26	[youtube:tab] Support youtube music MP pages	2021-05-18 19:31:08 +05:30
pukkandan	18db754858	[youtube:tab] Redirect UC channels that doesn't have a videos tab ... Many topic URLs don't have a videos tab, but has an equivalent `UU` playlist. If there is no playlist, fallback to using channel page	2021-05-18 19:31:07 +05:30
pukkandan	fe03a6cdc8	[youtube:tab] Support youtube music VL and browse pages	2021-05-18 19:31:06 +05:30
pukkandan	cd684175ad	[youtube:tab] Support channel search ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/29071	2021-05-18 19:30:21 +05:30
pukkandan	da692b7920	[cleanup] youtube tests	2021-05-18 18:10:15 +05:30
pukkandan	95c01b6c16	[youtube:tab] Show alerts only from the final webpage	2021-05-18 18:09:04 +05:30
pukkandan	5112f26a60	Add pl_thumbnail outtmpl key for playlist thumbnails ... This should have been implemented in 681de68e9d, but I forgot	2021-05-18 17:12:20 +05:30
pukkandan	a06916d98e	[extractor] Add write_debug and get_param	2021-05-17 18:59:51 +05:30
pukkandan	681de68e9d	Write thumbnail of playlist ... Related: https://github.com/ytdl-org/youtube-dl/pull/28872, https://github.com/ytdl-org/youtube-dl/pull/28860 This is slightly different from the above PRs in that this downloads the playlist's thumbnail instead of the uploader's profile picture. But for youtube channel URLs these are the same	2021-05-17 18:24:17 +05:30
pukkandan	7aee40c13c	Fix bug in listing subtitles ... Bug introduced by: 2412044c90	2021-05-17 18:24:16 +05:30
coletdjnz	9297939ec3	[Youtube] Extract more formats for music.youtube URLs (#311) ... Based on: https://github.com/ytdl-org/youtube-dl/pull/28778, https://github.com/ytdl-org/youtube-dl/pull/26160 Co-authored-by: craftingmod, colethedj, pukkandan	2021-05-15 20:08:47 +05:30
pukkandan	774d79cc4c	[youtube] Add language names ... Co-authored by: nixxo, tpikonen Based on: https://github.com/ytdl-org/youtube-dl/pull/26112 Closes: #310	2021-05-15 19:27:53 +05:30
pukkandan	2412044c90	Add field name for subtitles ... Co-authored by: pukkandan, tpikonen Based on: #310, https://github.com/ytdl-org/youtube-dl/pull/26112	2021-05-15 19:27:52 +05:30
pukkandan	120916dac2	[youtube] multiple subtitles in same language ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/21164 Related: #310, https://github.com/ytdl-org/youtube-dl/pull/26112	2021-05-15 19:27:48 +05:30
pukkandan	fe346461ff	Fix --check-formats when there is network error	2021-05-15 19:26:01 +05:30
pukkandan	d2a1fad968	[compat] Fix py2	2021-05-14 13:35:13 +05:30
pukkandan	0fb983f62d	[youtube] Extract audio language	2021-05-14 13:15:48 +05:30
pukkandan	53c18592d3	Add option --print ... Deprecates: `--get-description`, `--get-duration`, `--get-filename`, `--get-format`, `--get-id`, `--get-thumbnail`, `--get-title`, `--get-url` Closes #295	2021-05-14 13:15:47 +05:30
pukkandan	e632bce2e4	[options] Refactor callbacks	2021-05-14 13:15:47 +05:30
pukkandan	0760b0a7e2	Standardize write_debug	2021-05-14 13:15:29 +05:30
pukkandan	d908aa636a	[cleanup] Fix typos	2021-05-11 23:34:40 +05:30
pukkandan	3d89341b47	[common] bugfix for when compat_opts is not given	2021-05-11 23:29:26 +05:30
pukkandan	d8ec40b39f	[rmcdecouverte] Generalize _VALID_URL ... Closes #291	2021-05-11 18:57:55 +05:30
pukkandan	4171221823	Add compat-option no-attach-infojson	2021-05-11 14:25:31 +05:30
pukkandan	eaeca38fc4	[version] update :ci skip all	2021-05-11 13:42:58 +05:30
pukkandan	fac988053f	Release 2021.05.11 ... * and some documentation improvements	2021-05-11 13:35:05 +05:30
pukkandan	61241abbb0	[generic] Respect the encoding in manifest	2021-05-11 13:32:03 +05:30
pukkandan	53ed7066ab	Option --compat-options to revert some of yt-dlp's changes ... * Deprecates `--list-formats-as-table`, `--list-formats-old`	2021-05-11 13:30:48 +05:30
pukkandan	a61f4b287b	Deprecate support for python versions < 3.6 ... Closes #267	2021-05-09 04:32:23 +05:30
pukkandan	486fb17975	Remove -l, -t, -A completely and disable --auto-number, --title, --literal, --id	2021-05-09 04:22:29 +05:30
pukkandan	2f567473c6	[Plugins] Prioritize plugins over standard extractors ... and prevent plugins from overwriting the standard extractor classes Closes #304	2021-05-09 04:22:27 +05:30
pukkandan	000ee7ef34	[fragment] Make sure first segment is not skipped	2021-05-09 04:22:26 +05:30
pukkandan	41d1cca328	Update to ytdl-commit-a726009 ... [blinkx] Remove extractor a726009987	2021-05-06 21:31:20 +05:30
pukkandan	717297545b	Fix playlist_index and add playlist_autonumber (#302) ... Now `playlist_index` is always the position of the video in the actual playlist and `playlist_autonumber` is the position of the item in the playlist queue	2021-05-06 20:56:19 +05:30
pukkandan	e8e738406a	Add experimental option --check-formats to test the URLs before format selection	2021-05-06 20:50:44 +05:30
pukkandan	e625be0d10	Improve output template internal formatting ... * Allow slicing lists/strings using `field.start🔚step` * A field can also be used as offset like `field1+num+field2` * A default value can be given using `field|default` * Capture all format strings and set it to `None` if invalid. This prevents invalid fields from causing errors	2021-05-06 20:28:58 +05:30
pukkandan	12e73423f1	[plutotv] Fix format extraction for some urls ... * And fallback to the first urls if ad-free urls can't be found Closes #299	2021-05-06 20:28:57 +05:30
pukkandan	7700b37f39	[plutotv] Extract subtitles from manifests	2021-05-06 20:28:56 +05:30
Ashish	c28cfda81f	[SonyLiv] Fix title and series extraction (#301) ... Authored by: Ashish0804	2021-05-06 20:27:43 +05:30
pukkandan	848887eb7a	[downloader] Fix quiet and to_stderr	2021-05-04 22:38:10 +05:30
pukkandan	3158150cb7	[utils] Add network_exceptions	2021-05-04 22:36:18 +05:30
pukkandan	6ef6bcbd6b	[fragment] Ensure the file is closed on error	2021-05-04 22:27:44 +05:30
pukkandan	06425e9621	[blinkx] Minor fix ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/28941	2021-05-04 22:27:44 +05:30
pukkandan	4d224a3022	[embedthumbnail] Fix bug where jpeg thumbnails were converted again ... Closes #297	2021-05-04 22:18:40 +05:30
pukkandan	f59ae58163	Fix number of digits in %(playlist_index)s ... When used with `--playlist-(items|start|end)`, the number of digits should depend on the last index in the playlist, not number of items	2021-05-03 22:49:05 +05:30
pukkandan	0d1bb027aa	Move option warnings to YoutubeDL ... Previously, these warnings did not obey `--no-warnings` and did not output colors	2021-05-03 22:49:04 +05:30
pukkandan	4cd0a709aa	Fix preload_download_archive writing verbose message to stdout ... * And move it after all deprecated warnings	2021-05-03 22:49:03 +05:30
pukkandan	1815d1028b	[zee5] Fix py2 compatibility	2021-05-03 22:49:03 +05:30
The Hatsune Daishi	0fa9a1e236	[whowatch] Add extractor #292 ... closes #223 Authored by: nao20010128nao Modified from: 9e4a0e061a/youtube_dl/extractor/whowatch.py	2021-05-02 19:43:37 +05:30
pukkandan	eb55bad5a0	[aria2c] Fix whitespace being stripped off ... Closes #276	2021-05-02 14:03:13 +05:30
pukkandan	cc0ec3e161	Do not strip out whitespaces in -o and -P ... Related: https://github.com/yt-dlp/yt-dlp/issues/276#issuecomment-827361652	2021-05-02 14:03:12 +05:30
pukkandan	80185155a1	[ukcolumn] Add Extractor ... Closes #287	2021-05-02 13:57:50 +05:30
pukkandan	c755f1901f	[CBS] Improve _VALID_URL to support movies ... Closes #290 Tested by: BeeMuffins	2021-05-01 21:32:14 +05:30
pukkandan	68b91dc905	[youtube] Add oembed to reserved names	2021-05-01 21:24:31 +05:30
pukkandan	88f06afc0c	[rmcdecouverte] Improve _VALID_URL ... Closes #291	2021-05-01 21:24:31 +05:30
CXwudi	40078a55e2	[niconico] Fix bug in thumbnail extraction #289 ... Bug from: 6b1d8c1e30 Authored by: CXwudi	2021-05-01 19:35:47 +05:30
pukkandan	d2558234cf	[utils] Escape URL while sanitizing ... Closes #263 While this fixes the issue in question, it does not try to address the root-cause of the problem Refer: 915f911e36, f5fa042c82	2021-04-29 05:20:50 +05:30
pukkandan	f5fa042c82	Revert "[utils] Encode URLs in YoutubeDLCookieProcessor" ... This reverts commit 915f911e36. When the request is copied, `unredirected_hdrs` are not copied, which causes issues elsewhere Reopens #263	2021-04-29 05:20:18 +05:30
pukkandan	07e4a40a9a	[crackle] Improve extraction (See desc) ... Closes #282 * Refactor authorization as an extension to `_download_json` * Better error messages and warnings * Respect `--ignore-no-formats-error` * Extract subtitles from manifests * Try with crackle's geo-location service if all hard-coded countries fail	2021-04-29 05:20:16 +05:30
pukkandan	e28f1c0ae8	[cleanup] Fix linter and some typos ... * Also remove inconsistent use of `"` in setup.py	2021-04-28 19:59:40 +05:30
pukkandan	ef39f8600a	[curiositystream] Fix collections ... Closes #277 * A bug with authentication was reported in <https://github.com/yt-dlp/yt-dlp/issues/277#issuecomment-828254721> but cannot be tested without an account	2021-04-28 19:29:33 +05:30
pukkandan	2291dbce2a	[niconico] Fix HLS formats ... Closes #171 * The structure of the API JSON was changed * Smile Video seems to be no longer available. So remove the warning * Move ping to downloader * Change heartbeat interval to 40sec * Remove unnecessary API headers Authored-by: CXwudi, tsukumijima, nao20010128nao, pukkandan Tested by: tsukumijima	2021-04-28 19:18:29 +05:30
pukkandan	58f197b76c	Revert "[core] be able to hand over id and title using url_result" ... This reverts commit 0704d2224b. This is a commit from `youtube-dlc`. It is not clear what the original purpose of this was. It seems to be a way for extractors to pass `title` and `id` through when the entry is processed by another extractor * But `title` can already be passed through using `url_transparent` * `id` is never supposed to be passed through since it could cause issues with archiving	2021-04-28 19:18:06 +05:30
pukkandan	895b0931e5	[youtube:tab] Detect playlists inside community posts	2021-04-28 19:18:06 +05:30
pukkandan	1ad047d0f7	[nebula] Move to nebula.app ... Closes #272 Tested by: Lamieur	2021-04-28 19:18:06 +05:30
pukkandan	be6202f12b	Subtitle extraction from streaming media manifests #247 ... Authored by fstirlitz Modified from: https://github.com/ytdl-org/youtube-dl/pull/6144 Closes: #73 Fixes: https://github.com/ytdl-org/youtube-dl/issues/6106 https://github.com/ytdl-org/youtube-dl/issues/14977 https://github.com/ytdl-org/youtube-dl/issues/21438 https://github.com/ytdl-org/youtube-dl/issues/23609 https://github.com/ytdl-org/youtube-dl/issues/28132 Might also fix (untested): https://github.com/ytdl-org/youtube-dl/issues/15424 https://github.com/ytdl-org/youtube-dl/issues/18267 https://github.com/ytdl-org/youtube-dl/issues/23899 https://github.com/ytdl-org/youtube-dl/issues/24375 https://github.com/ytdl-org/youtube-dl/issues/24595 https://github.com/ytdl-org/youtube-dl/issues/27899 Related: https://github.com/ytdl-org/youtube-dl/issues/22379 https://github.com/ytdl-org/youtube-dl/pull/24517 https://github.com/ytdl-org/youtube-dl/pull/24886 https://github.com/ytdl-org/youtube-dl/pull/27215 Notes: * The functions `extractor.common._extract_..._formats` are still kept for compatibility * Only some extractors have currently been moved to using `_extract_..._formats_and_subtitles` * Direct subtitle manifests (without a master) are not supported and are wrongly identified as containing video formats * AES support is untested * The fragmented TTML subtitles extracted from DASH/ISM are valid, but are unsupported by `ffmpeg` and most video players * Their XML fragments can be dumped using `ffmpeg -i in.mp4 -f data -map 0 -c copy out.ttml`. Once the unnecessary headers are stripped out of this, it becomes a valid self-contained ttml file * The ttml subs downloaded from DASH manifests can also be directly opened with <https://github.com/SubtitleEdit> * Fragmented WebVTT files extracted from DASH/ISM are also unsupported by most tools * Unlike the ttml files, the XML fragments of these cannot be dumped using `ffmpeg` * The webtt subs extracted from DASH can be parsed by <https://github.com/gpac/gpac> * But validity of the those extracted from ISM are untested	2021-04-28 19:02:43 +05:30
Felix S	e8f834cd8d	[threeqsdn] Extract subtitles from streaming manifests	2021-04-28 17:24:50 +05:30
Felix S	e0e624ca7f	[canvas] Extract subtitles from streaming manifests	2021-04-28 17:24:19 +05:30
Felix S	ec4f374c05	[wat] Extract subtitles from streaming manifests	2021-04-28 17:24:08 +05:30
Felix S	c811e8d8bd	[atresplayer] Extract subtitles from streaming manifests	2021-04-28 17:23:56 +05:30
Felix S	b2cd5da460	[francetv] Extract subtitles from the HLS manifest	2021-04-28 17:23:47 +05:30
Felix S	2de3b21e05	[uplynk] Extract subtitles from HLS manifests	2021-04-28 17:23:37 +05:30
Felix S	4bed436371	[twitter] Extract subtitles from HLS manifests	2021-04-28 17:23:27 +05:30
Felix S	efe9dba595	[srgssr] Extract subtitles from HLS manifests	2021-04-28 17:23:16 +05:30
Felix S	47f4203dd3	[nytimes] Extract subtitles from HLS manifests	2021-04-28 17:23:05 +05:30
Felix S	015c10aeec	[roosterteeth] Use common code for subtitle extraction	2021-04-28 17:22:56 +05:30
Felix S	a00d781b73	[elonet] Use common code for subtitle extraction	2021-04-28 17:22:45 +05:30
Felix S	0c541b563f	[tv4] Extract subtitles from streaming manifests	2021-04-28 17:22:36 +05:30
Felix S	64a5cf7929	[byutv] Extract subtitles from streaming manifests	2021-04-28 17:22:27 +05:30
Felix S	7a450a3b1c	[generic] Extract subtitles from direct SSTR manifest links	2021-04-28 17:22:18 +05:30
Felix S	7de27caf16	[generic] Extract subtitles from direct DASH manifest links	2021-04-28 17:22:07 +05:30
Felix S	c26326c1be	[generic] Extract subtitles from direct HLS manifest links	2021-04-28 17:21:55 +05:30
Felix S	66a1b8643a	[downloader/ism] Support muxing TTML subtitles	2021-04-28 17:21:45 +05:30
Felix S	15828bcf25	[downloader/hls] Handle MPEG-2 PES timestamp overflow	2021-04-28 17:21:35 +05:30
Felix S	333217f43e	[downloader/hls] Remove duplicate cues using a sliding window of candidates	2021-04-28 17:21:26 +05:30
Felix S	4a2f19abbd	[downloader/hls] Assemble single-file WebVTT subtitles from HLS segments	2021-04-28 17:21:14 +05:30
Felix S	f6a1d69a87	[extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks	2021-04-28 17:20:29 +05:30
Felix S	fd76a14259	[extractor/common, downloader/ism] Extract SSTR subtitle tracks ... _parse_ism_formats was extended into _parse_ism_formats_and_subtitles; all direct users were updated, though _extract_ism_formats was left as a compatibility wrapper. The SSTR downloader was also modified in order to prepare for muxing subtitle streams, although no support for any subtitle codecs was added in this commit.	2021-04-28 17:20:20 +05:30
Felix S	171e59edd4	[extractor/common] Extract DASH subtitle tracks ... _extract_mpd_formats and _parse_mpd_formats were extended into _…_formats_and_subtitles; wrappers with old names are provided for compatibility.	2021-04-28 17:20:11 +05:30
Felix S	a0c3b2d5cf	[extractor/common] Extract HLS subtitle tracks ... _extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles and extended to handle subtitle tracks instead of skipping them; a wrapper with the old name is provided for compatibility. _parse_m3u8_formats is likewise renamed and extended, but without adding the compatibility wrapper; the test suite is adjusted to test the enhanced method instead.	2021-04-28 17:19:57 +05:30
Felix S	19bb39202d	[extractor/common] Generalise _merge_subtitles ... This allows modifying a subtitles dictionary in-place.	2021-04-28 17:19:46 +05:30
Felix S	d4553567d2	[downloader/ism] Prevent writing the header again when resuming an interrupted download	2021-04-28 17:19:37 +05:30
Felix S	4d49884c58	[downloader/fragment] Allow persisting extra state when a download is interrupted	2021-04-28 17:19:31 +05:30
Felix S	5873d4ccdd	[utils] Improve bug_report_message ... Add an optional argument specifying the text that should go before the message.	2021-04-28 17:19:23 +05:30
Hadi0609	db9a564b6a	[zee5] Fix extraction for some URLs (#279) ... Closes: #278	2021-04-28 14:51:54 +05:30
Felix S	c72967d5de	[mediasite] Generalize URL pattern (#275) ... Authored by: fstirlitz	2021-04-26 17:23:20 +05:30
pukkandan	598d185db1	Fix case sensitivity of format selector ... Bug introduced in f8d4ad9ab0	2021-04-26 10:56:56 +05:30
pukkandan	b982cbdd0e	[limelight] Obey allow_unplayable_formats	2021-04-26 10:56:55 +05:30
pukkandan	6a04a74e8b	[FormatSort] Fix for when some formats have quality and others don't	2021-04-26 10:56:54 +05:30
pukkandan	88728713c8	Py2 compatibility for FileNotFoundError	2021-04-26 10:56:53 +05:30
CXwudi	6b1d8c1e30	[niconico] Fix title and thumbnail extraction (#273) ... Authored by: CXwudi	2021-04-26 08:23:57 +05:30
Ashish	87c3d06271	[Mxplayer] Add MxplayerShowIE (#270) ... Authored by: Ashish0804	2021-04-26 08:12:51 +05:30
pukkandan	915f911e36	[utils] Encode URLs in YoutubeDLCookieProcessor ... Closes #263	2021-04-24 19:20:07 +05:30
pukkandan	cf9d6cfb0c	[tubi] Raise "no video formats" error when video url is empty ... Related: #266	2021-04-24 17:52:33 +05:30
pukkandan	bbed5763f1	[francetvinfo] Improve video id extraction ... Closes #261	2021-04-23 00:01:09 +05:30
pukkandan	ca0b91b39e	[version] update :ci skip all	2021-04-22 17:30:36 +05:30
pukkandan	e58c22a0f6	[documentation] Fix typos	2021-04-22 16:54:44 +05:30
pukkandan	1bdae7d312	Update to ytdl-commit-7e8b3f9 ... [youtube] Remove unused code 7e8b3f9439	2021-04-22 16:54:07 +05:30
Felix S	a471f21da6	[mildom] Remove proxy (#260) ... Closes #251 Makes 2cff495997, ab406a1c0e, #252 obsolete Authored by: fstirlitz	2021-04-22 16:52:22 +05:30
pukkandan	6efb071135	[BilibiliChannel] Fix pagination ... Closes #222 ccca21d7f5 Coauthored by: nao20010128nao, pukkandan	2021-04-22 04:19:33 +05:30
pukkandan	a439a3a45c	Improve output template (see desc) ... * Objects can be traversed like `%(field.key1.key2)s` * A number can be added to the field as `%(field+n)s` * Deprecates `--autonumber-start`	2021-04-22 04:19:33 +05:30
pukkandan	26e2805c3f	Add option --skip-playlist-after-errors ... Allows to skip the rest of a playlist after a given number of errors are encountered	2021-04-22 02:16:31 +05:30
pukkandan	3b4775e021	[go] Fix _VALID_URL ... Closes #255	2021-04-21 15:43:53 +05:30
pukkandan	ab406a1c0e	[mildom] Warn user of proxy	2021-04-21 15:43:22 +05:30
pukkandan	a3faeb7de4	[MetadataFromField] Improve regex and add tests	2021-04-21 11:12:04 +05:30
pukkandan	8c54a3051d	[youtube] Bugfix in _extract_ytcfg	2021-04-21 10:37:24 +05:30
pukkandan	c32b0aab8a	Improve --sub-langs (see desc) ... * Treat `--sub-langs` entries as regex * `all` can be used to refer to all the subtitles * the language code can be prefixed with `-` to exclude it * Deprecates `--all-subs` Closes #253	2021-04-20 02:58:03 +05:30
pukkandan	3097d9e512	[mildom:user:vod] Download only necessary amount of pages	2021-04-19 11:41:49 +05:30
pukkandan	c1df120eda	[mildom:vod] Remove proxy ... * Proxy is needed only for live videos	2021-04-19 11:41:40 +05:30
pukkandan	2cff495997	[mildom] Change proxy ... Related: #251 Closes #252	2021-04-19 11:41:33 +05:30
pukkandan	d0491a1ebe	[twitcasting] Fix extractor ... * `Origin: https://twitcasting.tv` must be sent when requesting the webpage. Otherwise the extracted `m3u8` will always give a `502` * Fix regex for when `data-movie-playlist` is a dict containing the needed list * media initialization is fully supported; so change downloader to native Closes #220	2021-04-18 17:57:46 +05:30
nixxo	b9d68c199b	[rai] Add support for http formats (#208) ... Authored by: nixxo	2021-04-17 22:42:28 +05:30
pukkandan	201c145953	Update to ytdl-commit-9f6c03 ... [cbsnews] Fix extraction for python <3.6 9f6c03a006	2021-04-17 08:40:31 +05:30
pukkandan	5d34200268	[youtube:tab] Reload with unavailable videos for all playlists ... If the unavailable video is in a later page, the warning and button are not shown in the initial webpage So we force all playlists' initial page to reload with the correct params	2021-04-17 08:40:30 +05:30
pukkandan	b7da73eb19	Add option --ignore-no-formats-error ... * Ignores the "no video format" and similar errors * Experimental - Some extractors may still throw these errors	2021-04-17 08:40:30 +05:30
pukkandan	6a39ee13f7	Fix inconsistent use of report_warning	2021-04-17 04:16:41 +05:30
pukkandan	33245766ab	[downloader] Fix ffmpeg selection for m3u8_native	2021-04-17 04:15:56 +05:30
coletdjnz	358de58c4d	[youtube:tab] Show unavailable videos in playlists (#242) ... Closes #231 Authored by: colethedj	2021-04-17 04:09:08 +05:30
pukkandan	a7191c6f57	Fix some linter and typos	2021-04-16 05:31:47 +05:30
lkho	baa5873942	[viu:ott] Fix extractor (see desc) ... * add language_flag_id query param * add support for premium account (untested since I dont have a premium account) * support entire series Code from: https://github.com/blackjack4494/youtube-dlc/pull/211 https://github.com/ytdl-org/youtube-dl/pull/15182 https://github.com/ytdl-org/youtube-dl/pull/26775 Fixes: https://github.com/yt-dlp/yt-dlp/issues/219 https://github.com/ytdl-org/youtube-dl/issues/27946 https://github.com/ytdl-org/youtube-dl/issues/27863 https://github.com/ytdl-org/youtube-dl/issues/27812 https://github.com/ytdl-org/youtube-dl/issues/27464 https://github.com/ytdl-org/youtube-dl/issues/26788 https://github.com/blackjack4494/yt-dlc/issues/136 Possibly also fixes (untested): https://github.com/ytdl-org/youtube-dl/issues/16992 https://github.com/ytdl-org/youtube-dl/issues/26701 Co-authored by: lkho, pukkandan	2021-04-16 05:19:46 +05:30
pukkandan	c6ce815461	[Exec] Ensure backward compatibility when the command contains %	2021-04-16 05:19:44 +05:30
coletdjnz	79360d99d3	[youtube] Standardize API calls for tabs, mixes and search (#245) ... Authored by: colethedj	2021-04-15 16:52:59 +05:30
pukkandan	46fff7105e	[youtube] Ignore invalid stretch ratio ... Closes #244	2021-04-14 15:22:17 +05:30
pukkandan	72e1fe969f	[downloader] Fix downloader selection for m3u8 ... Bug introduced by: 52a8a1e1b9 and a31953b0e6	2021-04-14 12:25:42 +05:30
Ashish	b5be6dd504	[TubiTv] Add TubiTvShowIE (#243) ... Authored by: Ashish0804	2021-04-14 12:22:28 +05:30
coletdjnz	8ea3f7b909	[youtube] Improve channel syncid extraction to support ytcfg (#241) ... Authored by: colethedj	2021-04-14 10:37:03 +05:30
pukkandan	921b76cab8	Ensure mergeall selects best format when multistreams are disabled	2021-04-13 10:53:25 +05:30
pukkandan	a31953b0e6	[downloader] Fix external downloader selection for m3u8 ... Closes #239	2021-04-12 22:34:11 +05:30
pukkandan	54670cf084	[version] update ... :ci skip all	2021-04-12 03:30:55 +05:30
pukkandan	b31fdeedfd	[documentation] Improvements	2021-04-12 02:36:06 +05:30
pukkandan	8fa43c73d8	Add option --convert-thumbnails ... Closes: https://github.com/yt-dlp/yt-dlp/issues/99 https://github.com/yt-dlp/yt-dlp/issues/102	2021-04-12 02:32:29 +05:30
pukkandan	56d868dbb7	Allow running some postprocessors before actual download	2021-04-12 02:12:46 +05:30
coletdjnz	f4f751af40	[youtube] Parse API parameters from initial webpage (#230) ... * Obtain innertube_context, api_key and x-goog-visitor-id from webpage * Generalize the header & Innertube_context extraction across YouTube extractors Related: 1b0a13f33c Authored by: colethedj	2021-04-12 01:53:04 +05:30
pukkandan	1988fab7e3	[youtube] Fix thumbnail URL ... Closes: https://github.com/yt-dlp/yt-dlp/issues/233 https://github.com/ytdl-org/youtube-dl/issues/28023	2021-04-11 06:06:13 +05:30
pukkandan	9de3ea3126	Pass any field to --exec using similar syntax to output template ... Related: https://github.com/ytdl-org/youtube-dl/issues/28642	2021-04-11 06:06:12 +05:30
pukkandan	e01d6aa435	Fix mergeall when requested formats are unavailable	2021-04-10 22:29:58 +05:30
pukkandan	f7ad71607d	Update to ytdl-commit-4fb25ff ... [maoritv] Add new extractor 4fb25ff5a3 Except: [vimeo] improve extraction 3ae9c0f410 [youtube:tab] Pass innertube context... 1b0a13f33c	2021-04-10 22:19:54 +05:30
pukkandan	68379de561	[downloaders] Fix API access ... Bug introduced by: 52a8a1e1b9	2021-04-10 21:15:32 +05:30
pukkandan	d9aa233295	Deprecate more options ... * `--all-formats` = `-f all` * `--include-ads` is not implemented	2021-04-10 20:58:36 +05:30
pukkandan	f37468c41f	Fix default of dynamic_mpd	2021-04-10 20:57:53 +05:30
pukkandan	52a8a1e1b9	Option to choose different downloader for different protocols ... * Renamed `--external-downloader-args` to `--downloader-args` * Added `native` as an option for the downloader * Use similar syntax to `--downloader-args` etc. Eg: `--downloader dash:native --downloader aria2c` * Deprecated `--hls-prefer-native` and `--hls-prefer-ffmpeg` since the same can now be done with `--downloader "m3u8:native"` and `m3u8:ffmpeg` respectively * Split `frag_urls` protocol into `m3u8_frag_urls` and `dash_frag_urls` * Standardize shortening of protocol names with `downloader.shorten_protocol_name`	2021-04-10 20:57:52 +05:30
pukkandan	d818eb7473	Improve argument parsing for -P, -o, -S ... * `-P "subtitle,thumbnail:PATH"` is now possible. Similarly for `-o` * `-S "fps,br" -S "res,codec"` is now interpreted as `-S res,codec,fps,br`. Previously, `-S fps,br` was ignored in this case.	2021-04-10 20:57:27 +05:30
pukkandan	f8d4ad9ab0	Format selector mergeall to download and merge all formats	2021-04-10 20:57:27 +05:30
pukkandan	3ffc7c89b0	[youtube] Fix _extract_alerts ... * Sometimes one warning is split between multiple runs * Also simplified code	2021-04-10 20:57:27 +05:30
Henrik Heimbuerger	f1823403b0	[nebula] Add extractor (watchnebula.com) (#122) ... Authored by: hheimbuerger	2021-04-09 16:57:38 +05:30
LE	384fb069ec	[NFHSNetwork] Add extractor (#217) ... Authored by: llacb47	2021-04-09 15:33:10 +05:30
bopol	a4ddaf231e	[nitter] Fix extraction of reply tweets (#218) ... And update instance list Closes #215 Authored by: B0pol	2021-04-08 22:33:36 +05:30
pukkandan	7e60c06925	[bilibili] Fix uploader ... Related: https://github.com/yt-dlp/yt-dlp/issues/222	2021-04-08 13:22:04 +05:30
coletdjnz	d92f5d5a90	[youtube] Extract comments' approximate timestamp (#221) ... Authored by: colethedj	2021-04-07 17:09:06 +05:30
colethedj	9e62f283ff	[utils] Add datetime_from_str to parse relative time (#221) ... and `datetime_add_months` to accurately add/subtract months Authored by: colethedj	2021-04-07 17:09:06 +05:30
bopol	c24ce07a84	[nitter] Fix thumbnails (#216) ... Authored by: B0pol	2021-04-05 16:53:33 +05:30
Ashish	de6758128e	[DiscoveryPlusIndia] Add DiscoveryPlusIndiaShowIE (#213) ... Co-authored-by: Ashish <ashish@pop-os.localdomain> Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>	2021-04-05 16:20:08 +05:30
pukkandan	73d4343e39	Fix some m3u8 not obeying --allow-unplayable-formats	2021-04-04 17:53:26 +05:30
pukkandan	57d104424f	[version] update ... :ci skip all	2021-04-04 03:57:29 +05:30
pukkandan	39ed931e53	Update to ytdl-commit-654b4f4 ... [youtube] prioritize information from YoutubeIE for playlist entries 654b4f4ff2	2021-04-04 03:49:04 +05:30
Matthew	b28f8d244a	[YouTube] Show premium state in availability (#209) ... Authored by colethedj	2021-04-03 14:20:58 +05:30
pukkandan	73cd218f5a	[documentation] Improve --parse-metadata documentation	2021-04-03 14:07:29 +05:30
pukkandan	84601bb72b	Ability to set a specific field in the file's metadata ... Eg: `--parse-metadata "description:(?s)(?P<meta_comment>.+)"` sets the "comment" field using `description`	2021-04-03 14:07:28 +05:30
pukkandan	54df8fc5b2	[ViewSource] Add extractor to handle view-source:	2021-04-03 14:07:27 +05:30
The Hatsune Daishi	5d39972ed0	[mildom] Update extractor to comply with current proxy (#212) ... Authored by nao20010128nao	2021-04-03 13:43:49 +05:30
pukkandan	0481374e1d	[DiscoveryPlus] Add discoveryplus.in (#203) ... Closes #201	2021-04-03 13:18:40 +05:30
pukkandan	eff635394a	Ability to select nth best format ... Eg: -f `bv*.2` * Also cleaned up the related format selection code	2021-04-02 22:16:52 +05:30
pukkandan	df0c81513e	[generic] Detect Invidious' link element (Closes #195)	2021-04-01 17:13:35 +05:30
pukkandan	3f6a90eb63	[ard:mediathek] Fix video id extraction (Closes #202)	2021-04-01 16:17:15 +05:30
pukkandan	b050d210df	Fix some typos and linter	2021-04-01 14:16:10 +05:30
pukkandan	f4e4be19f0	[sponskrub] Run before embedding thumbnail ... Workaround for https://github.com/faissaloo/SponSkrub/issues/29 Closes https://github.com/yt-dlp/yt-dlp/issues/204	2021-04-01 14:13:24 +05:30
pukkandan	cce889b900	Update to ytdl v2021-04-01 ... 14f29f087e Closes #205	2021-04-01 13:59:22 +05:30
nixxo	a6ae61a4c2	[la7] Add podcasts and podcast playlists (#198) ... Authored by: nixxo	2021-03-28 17:06:59 +05:30
pukkandan	b23b9eefd9	[version] update	2021-03-25 04:44:22 +05:30
pukkandan	a2f0b0c672	Release 2021.03.24.1	2021-03-25 04:33:34 +05:30
pukkandan	b704fc1a68	Revert commit 8562218 ... [ard] improve clip id extraction 8562218350 This was merged incorrectly	2021-03-25 04:31:32 +05:30
pukkandan	a3affbe6a0	Release 2021.03.24	2021-03-25 04:18:37 +05:30
pukkandan	1418a0437f	Update to ytdl-commit-8562218 ... [ard] improve clip id extraction 8562218350	2021-03-25 04:09:21 +05:30
pukkandan	143db31d48	Parse metadata from multiple fields ... Closes #196	2021-03-25 03:32:15 +05:30
pukkandan	3700c7ef10	[linuxacadamy] Fix login	2021-03-24 04:06:26 +05:30
pukkandan	498f560638	Ability to load playlist infojson ... * If `--no-clean-infojson` is given, the video ids are saved/loaded from in the infojson along with their playlist index * If a video entry that was not saved is requested, we fallback to using `webpage_url` to re-extract the entries Related: https://github.com/yt-dlp/yt-dlp/issues/190#issuecomment-804921024	2021-03-24 01:57:50 +05:30
pukkandan	394dcd4486	Write current epoch to infojson when using --no-clean-infojson ... Closes #191	2021-03-24 00:34:33 +05:30
pukkandan	83b20a970d	[youtube_live_chat] fix bug when trying to set cookies ... Closes #194	2021-03-23 17:53:36 +05:30
pukkandan	e1feb88fdf	[niconico] Fix for when logged in ... Related: https://github.com/yt-dlp/yt-dlp/issues/171#issuecomment-803692716 Co-authored by: CXwudi, xtkoba	2021-03-23 14:03:07 +05:30
pukkandan	389b9dbbcc	[version] update	2021-03-22 03:03:06 +05:30
pukkandan	421a459573	Update to ytdl-commit-7e79ba7 ... 7e79ba7dd6 [vimeo:album] Fix extraction for albums with number of videos multiple to page size	2021-03-22 02:58:41 +05:30
Matthew	c224251aad	[youtube] Show if video is private, unlisted etc in new field availability (#188) ... Closes: #185, https://github.com/ytdl-org/youtube-dl/issues/25631 Authored by: colethedj, pukkandan	2021-03-22 02:58:41 +05:30
pukkandan	037cc66ec8	[linuxacadamy] Improve regex ... TODO: We need to make a more robust standard regex for fetching js objects from html	2021-03-21 21:27:33 +05:30
Two Sheds" Jackson	9160a0c6a2	[nbc] Improve metadata extraction (#187) ... Authored by: 2ShedsJackson	2021-03-21 21:26:31 +05:30
2ShedsJackson	5c5fae6d2f	[amcnetworks] Fix extractor (#179) ... * Prefer use of manifest based on `releasePid` since the one based on `videoPid` may have Fairplay * Additional thumbnail images were added * Don't add `season_number` and `series` to `title` * `series` is now set to `None` rather than "_" when empty * fix bug with age limit Authored by: 2ShedsJackson	2021-03-20 16:11:11 +05:30
pukkandan	c1d3a4a8f0	[niconico] Add user extractor ... Co-authored by: animelover1984	2021-03-20 14:59:39 +05:30
pukkandan	adc74b3c6d	[bilibili] Add anthology support ... Closes: #118 Co-authored by: animelover1984	2021-03-20 14:56:42 +05:30
pukkandan	beb4b92a66	More consistent warning messages (#173) ... Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>	2021-03-20 09:34:52 +05:30
pukkandan	cd9b384cc3	Embed video URL metadata inside MP4 (#173) ... `mp4` has `comment` and `synopsis`; the synopsis is expected to have the long description So we save the `webpage_url` to `comment` and `description` to `synopsis` Related: https://github.com/ytdl-org/youtube-dl/issues/28478 Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>	2021-03-20 09:34:52 +05:30
pukkandan	4d971a16b8	Merge webm formats into mkv if thumbnails are to be embedded (#173) ... Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>	2021-03-20 09:34:52 +05:30
Damiano Amatruda	3561530776	Parse resolution in info dictionary (#173)	2021-03-20 09:34:52 +05:30