 simon
|
3ba6e0478d
|
fix filesysem rescan function
|
2022-03-19 14:36:46 +07:00 |
|
simon
|
b68a00073f
|
fix thumbnail validation with new PendingList class
|
2022-03-19 14:27:37 +07:00 |
|
simon
|
89428297c9
|
add download format channel overwrite per video
|
2022-03-18 22:22:41 +07:00 |
|
simon
|
ac9df4e082
|
map channel overwrite to video id for later efficient mapping
|
2022-03-18 21:39:33 +07:00 |
|
simon
|
a6937db5fd
|
use the refactored PendingList class
|
2022-03-18 18:27:25 +07:00 |
|
simon
|
05b8dbc02f
|
refacor PendingList class into subclasses
|
2022-03-18 17:19:21 +07:00 |
|
simon
|
1498fadf27
|
implement channel playlist index overwrite
|
2022-03-16 12:32:42 +07:00 |
|
simon
|
f0e82caebb
|
add bool true to channel overwrite form parser
|
2022-03-16 12:32:02 +07:00 |
|
simon
|
2ef8823c2d
|
better channel overwrite update form
|
2022-03-16 12:09:50 +07:00 |
|
simon
|
544d842a4a
|
rename channel format overwrite field
|
2022-03-15 17:45:15 +07:00 |
|
simon
|
774220ab1f
|
add channel overwrite form to frontend, store in es
|
2022-03-15 12:00:48 +07:00 |
|
simon
|
026cc378fe
|
add get_overwrites and set_overwrites methods for channel
|
2022-03-12 22:19:42 +07:00 |
|
simon
|
aff0cfb794
|
fix retiming issue for auto subtitles
|
2022-03-11 17:47:04 +07:00 |
|
simon
|
d3e9646fb6
|
private methods for YoutubeSubtitle and SubtitleParser
|
2022-03-10 20:45:13 +07:00 |
|
simon
|
1ce832b846
|
fix autocaption extraction, flatten words, #180
|
2022-03-10 19:58:13 +07:00 |
|
simon
|
c186798e78
|
rewrite SubtitleParser, #180
|
2022-03-09 00:25:44 +07:00 |
|
simon
|
b98ccd9dab
|
handle error if subscribed channel not available anymore, #175
|
2022-02-25 11:21:29 +07:00 |
|
simon
|
c4d6bb35a3
|
add list_items for wildcard matching
|
2022-02-24 18:55:18 +07:00 |
|
simon
|
ec00568008
|
fix auto reset of playlist_subscribed
|
2022-02-20 19:22:11 +07:00 |
|
simon
|
8fce31b983
|
fix reindex and deactivate error
|
2022-02-13 10:05:08 +07:00 |
|
simon
|
78720b33b7
|
clean exit when auto subtitle extract fails
|
2022-02-12 18:52:03 +07:00 |
|
simon
|
ce4fa8ee61
|
delete existing before of reindexing subtitles
|
2022-02-12 18:22:01 +07:00 |
|
simon
|
a5f6be16e1
|
switch subtitle source order
|
2022-02-12 17:09:05 +07:00 |
|
simon
|
b494fc10af
|
cover edge cases where end timestamp is after start timestamp of new cue
|
2022-02-12 16:03:04 +07:00 |
|
simon
|
09500557c8
|
open fail on subtitle line parse error
|
2022-02-11 18:47:29 +07:00 |
|
simon
|
08f5248e7a
|
make subtitle index optional
|
2022-02-11 13:36:36 +07:00 |
|
simon
|
af8e01cd8c
|
fix clean exit if no subtitles selected
|
2022-02-11 09:03:56 +07:00 |
|
simon
|
4d30bed3cc
|
extend delete video to also delete subtitles
|
2022-02-10 19:09:07 +07:00 |
|
simon
|
0e56efc428
|
limit filesystem scan to mp4 files only
|
2022-02-10 18:48:35 +07:00 |
|
simon
|
077692987b
|
fix multi language subtitle extractor, and better regex for timestamp matching
|
2022-02-10 18:32:23 +07:00 |
|
simon
|
b071612038
|
better error raising for add player info
|
2022-02-10 17:34:21 +07:00 |
|
simon
|
0414df0de0
|
fix key error for subtitle source
|
2022-02-10 17:10:30 +07:00 |
|
simon
|
a2cae51f48
|
bulk import subtitle lines into es
|
2022-02-10 17:02:19 +07:00 |
|
simon
|
9f652802ae
|
add new mapping for subtitle index
|
2022-02-10 11:47:14 +07:00 |
|
simon
|
4e4cfe3334
|
pass whole video object into YoutubeSubtitle class
|
2022-02-09 23:40:15 +07:00 |
|
simon
|
6cb892a811
|
integrate auto generated subtitle cleaner
|
2022-02-09 21:33:41 +07:00 |
|
simon
|
5f6158243e
|
auto generated subtitle parser and cleaner
|
2022-02-07 21:18:52 +07:00 |
|
simon
|
e98ffc0050
|
add subtitles mapping to video index
|
2022-02-05 23:50:47 +07:00 |
|
simon
|
52013aff3f
|
fix subtitle download of first video of channel without folder
|
2022-02-05 23:42:42 +07:00 |
|
simon
|
44af78b7e3
|
handle NA in ffprobe duration extractor
|
2022-02-05 23:09:05 +07:00 |
|
simon
|
2bf9e9683b
|
error handeling in _normalize_lang to skip livechat and ignore missing
|
2022-02-05 22:51:38 +07:00 |
|
simon
|
f5f46349b2
|
handle rescan name change
|
2022-02-05 22:38:59 +07:00 |
|
simon
|
ac531affb5
|
standardize country specific subtitle language codes
|
2022-02-05 16:07:11 +07:00 |
|
simon
|
3ef35a9d53
|
raise FileNotFoundError to catch for reindex
|
2022-02-05 09:30:34 +07:00 |
|
simon
|
7aaf140ccb
|
index subtitle url to video
|
2022-02-04 17:14:00 +07:00 |
|
simon
|
a82e78f8bf
|
index selected subtitles if available
|
2022-01-30 23:57:58 +07:00 |
|
simon
|
365a2bf59f
|
add frontend subtitle dl settings
|
2022-01-30 20:10:29 +07:00 |
|
simon
|
e5e83287ab
|
fix channel delete for channel_id fallback folders
|
2022-01-30 08:33:10 +07:00 |
|
simon
|
8e860d4f01
|
fix last page error for more than 10k results, #156
|
2022-01-27 23:39:07 +07:00 |
|
simon
|
0749202d5d
|
add fallback for none ascii channel names, #127 #146
|
2022-01-27 22:50:02 +07:00 |
|
simon
|
160676acc1
|
add mapping for channel_tvart_url
|
2022-01-27 21:56:48 +07:00 |
|
simon
|
87b72a571d
|
simplify reading json files
|
2022-01-27 15:32:58 +07:00 |
|
simon
|
b6f9fb58ad
|
refactor VideoDownloader class, better obs builder
|
2022-01-26 19:37:36 +07:00 |
|
simon
|
2fc0cbacf5
|
update doc strings to represent new module structure
|
2022-01-23 19:32:08 +07:00 |
|
simon
|
0fc0cc8e87
|
major refactor, split up modules
|
2022-01-22 22:13:37 +07:00 |
|
simon
|
b64a2f8195
|
squash index.py refactor commits
|
2022-01-22 17:48:54 +07:00 |
|
simon
|
2f4d4e715b
|
refactor index class in to base and video classes
|
2022-01-19 13:04:15 +07:00 |
|
simon
|
68f19b1719
|
make SearchHandler use new ElasticWrap class
|
2022-01-18 13:37:22 +07:00 |
|
simon
|
3eb0353fa9
|
new base class to make all es calls from
|
2022-01-18 13:36:41 +07:00 |
|
simon
|
af2783c18a
|
remove unneeded auth
|
2022-01-18 13:35:48 +07:00 |
|
simon
|
c703105c5e
|
fix ryd 404 error for reindex and deactivate
|
2022-01-11 18:54:40 +07:00 |
|
simon
|
8ba9ced833
|
move ryd to avoid celery missing redis var
|
2022-01-08 21:10:38 +07:00 |
|
simon
|
1a95797997
|
improve scheduler validation with regex, #126
|
2022-01-08 20:04:51 +07:00 |
|
simon
|
1cbe0bbfc0
|
delete playlists of channel when deleting channel, #118
|
2022-01-05 15:39:41 +07:00 |
|
simon
|
49cd272557
|
size limit for ryd missing rating query
|
2022-01-05 15:10:33 +07:00 |
|
simon
|
1c27934d77
|
remove redundant lock
|
2022-01-05 14:51:02 +07:00 |
|
simon
|
c85be45846
|
extend ryd to refresh when missing average_rating
|
2022-01-05 14:43:24 +07:00 |
|
simon
|
3999d679e3
|
fix linting
|
2022-01-05 14:09:35 +07:00 |
|
simon
|
dc2fb65312
|
add optin returnyoutubedislike.com integration
|
2022-01-05 14:06:07 +07:00 |
|
simon
|
6aef3dfb96
|
remove leftovers
|
2022-01-05 11:10:11 +07:00 |
|
simon
|
fd334bcafe
|
fix legacy import alias for yt-dlp
|
2022-01-02 15:38:45 +07:00 |
|
simon
|
4915aa0c11
|
remove now redundant search forms
|
2021-12-31 13:42:07 +07:00 |
|
simon
|
e8eb7077ed
|
add initial search endpoint and improve results$
|
2021-12-30 20:42:42 +07:00 |
|
simon
|
5fb15b79a4
|
extend SearchForm class with multisearch method for frontend
|
2021-12-30 15:58:15 +07:00 |
|
simon
|
2a774c3d3e
|
add english analyzer for main text fields for serching
|
2021-12-30 15:54:20 +07:00 |
|
simon
|
88ebb6d648
|
fix autodelete error on empty download queue
|
2021-12-18 17:05:49 +07:00 |
|
simon
|
ad8d75c3e8
|
add autodelete videos to ignore list, #112
|
2021-12-17 23:28:53 +07:00 |
|
simon
|
a500f9ec63
|
add notifications and error messages to settings page
|
2021-12-17 15:09:21 +07:00 |
|
simon
|
e858bba944
|
fix linting, update doc string
|
2021-12-16 12:48:12 +07:00 |
|
simon
|
9a2dead76c
|
implement autodelete watched videos after x days, #56
|
2021-12-16 12:44:37 +07:00 |
|
simon
|
7924f28ccb
|
implement backup rotate from config value
|
2021-12-14 19:40:46 +07:00 |
|
simon
|
f7c73f7eba
|
change backup and restore to tag files
|
2021-12-14 19:05:58 +07:00 |
|
simon
|
6ad1c8e73b
|
add reason to backup as file name tag
|
2021-12-13 21:20:48 +07:00 |
|
simon
|
21f70493bb
|
add scheduler config to regular redis config
|
2021-12-13 20:28:41 +07:00 |
|
simon
|
5cb6076a1c
|
use config check_reindex_days for refresh_interval
|
2021-12-13 19:19:49 +07:00 |
|
simon
|
8c5bb0bc1f
|
add missing mapping for playlist_last_refresh to fix empty index scan, #101
|
2021-12-06 16:56:56 +07:00 |
|
simon
|
82a71ed75d
|
clean up playlist subscribe notification
|
2021-12-05 22:35:46 +07:00 |
|
simon
|
8874168291
|
clean up progress hook title and speed up playlist validation
|
2021-12-05 21:57:33 +07:00 |
|
simon
|
19871d55e2
|
faster release message timer with reduced redis exipre time on last message
|
2021-12-05 21:27:43 +07:00 |
|
simon
|
67bde4c7ec
|
fix notification channel for video thumb download
|
2021-12-05 17:24:57 +07:00 |
|
simon
|
1d262fc936
|
fix old status variables for message
|
2021-12-05 16:41:06 +07:00 |
|
simon
|
b35440253d
|
transform add to queue, rescan, and download progress to channel messages
|
2021-12-03 19:47:43 +07:00 |
|
simon
|
1691bdadf5
|
transform progress message to list, change subscribe messages
|
2021-12-03 19:00:26 +07:00 |
|
simon
|
5a2d7c07bf
|
variable expire value and simpler REDIS_PORT declaration
|
2021-12-03 13:51:34 +07:00 |
|
simon
|
0b0634273a
|
validate form entries, set auto sensible default
|
2021-12-03 11:27:26 +07:00 |
|
simon
|
b2861e0369
|
ScheduleBuilder config class for celery beat
|
2021-12-02 18:37:54 +07:00 |
|
simon
|
7e97284374
|
auto index playlists when adding to download
|
2021-11-29 15:49:45 +07:00 |
|
simon
|
b14a820a4c
|
add 18 char len to valid playlists
|
2021-11-29 14:21:19 +07:00 |
|
simon
|
eacfd4bc84
|
refactor and move frontend PostData class to dedicated module
|
2021-11-28 18:42:04 +07:00 |
|
simon
|
d95bf4272c
|
speedup by only testing selected formats
|
2021-11-27 14:13:48 +07:00 |
|
simon
|
295ea0cde0
|
handling deactivating playlist
|
2021-11-27 11:47:12 +07:00 |
|
simon
|
1f82f0c40d
|
index playlist channel if doesn't exist and beter user feedback
|
2021-11-26 17:34:59 +07:00 |
|
simon
|
31515961e1
|
fix prev and nex playlist order
|
2021-11-26 16:47:39 +07:00 |
|
simon
|
5d7a609285
|
skip backing up not yet existing index
|
2021-11-26 16:19:18 +07:00 |
|
simon
|
32d2659658
|
handling genering index write errors, #91
|
2021-11-25 22:10:12 +07:00 |
|
simon
|
3f31e50b69
|
add delete download queue pending or ignored, #85
|
2021-11-25 20:02:25 +07:00 |
|
simon
|
2ebd0a3e2f
|
extend unsubscribe for channels and playlists
|
2021-11-25 11:52:14 +07:00 |
|
simon
|
e3f9bd98de
|
use --check-formats for downloader, #90
|
2021-11-25 11:17:25 +07:00 |
|
simon
|
b1783d6be3
|
handle multifeed videos with noplaylist
|
2021-11-22 22:58:25 +07:00 |
|
simon
|
9fceb98f13
|
add playlists to reindex class
|
2021-11-22 20:40:11 +07:00 |
|
simon
|
b292a5e309
|
add delete playlist backend functionality
|
2021-11-20 14:32:36 +07:00 |
|
simon
|
8d708fcdc8
|
add mark_playlist_watched and refactor mark_channel_watched to update_by_query
|
2021-11-20 10:58:25 +07:00 |
|
simon
|
fef26a06b2
|
force refresh for new videos to avoid racing condition
|
2021-11-19 16:26:05 +07:00 |
|
simon
|
3b6e70b4dc
|
progress message on validate_playlists
|
2021-11-19 15:53:06 +07:00 |
|
simon
|
3881d305f9
|
add subscribe to playlist form and better task management
|
2021-11-19 11:52:27 +07:00 |
|
simon
|
fcddf85245
|
validate_playlists after run_queue from VideoDownloader
|
2021-11-18 22:35:08 +07:00 |
|
simon
|
d0e0903d48
|
use remote data for playlist find_missing
|
2021-11-18 21:50:35 +07:00 |
|
simon
|
3efdc1962d
|
fix playlist nav builder using correct index
|
2021-11-18 21:16:18 +07:00 |
|
simon
|
a1167bac4e
|
use same page size for playlist rescan
|
2021-11-18 16:58:39 +07:00 |
|
simon
|
bb889f7f67
|
use find_missing to also add missing videos from playlist to download queue
|
2021-11-18 16:37:05 +07:00 |
|
simon
|
1af0196208
|
add subscribe to playlist backend functionality
|
2021-11-18 16:00:55 +07:00 |
|
simon
|
8b69be645c
|
use new IndexPaginate class for get_channels and get_playlists
|
2021-11-18 14:48:31 +07:00 |
|
simon
|
f371a03cc7
|
use new IndexPaginate class for get_all_indexed videos
|
2021-11-18 12:16:21 +07:00 |
|
simon
|
7b36cc53e7
|
refactor get_all_pending to use new IndexPaginate class
|
2021-11-17 18:30:24 +07:00 |
|
simon
|
ed9d5aef0a
|
fix playlist get_entries when not passing all youtube_ids
|
2021-11-17 18:16:22 +07:00 |
|
simon
|
c4b0f900f8
|
dedicated search_after class to scroll through index
|
2021-11-17 17:54:47 +07:00 |
|
simon
|
2fe8936e85
|
add playlist position index
|
2021-11-15 13:00:17 +07:00 |
|
simon
|
e450b38702
|
add video playlist navigation, previous and next
|
2021-11-14 19:34:57 +07:00 |
|
simon
|
8932a6bc02
|
validate existence of playlist entry in index
|
2021-11-14 15:46:24 +07:00 |
|
simon
|
ac14cd5ebb
|
playlist relation take 2
|
2021-11-13 17:34:58 +07:00 |
|
simon
|
7930da5242
|
fix youtu.be extractor, #40
|
2021-11-12 19:26:47 +07:00 |
|
simon
|
b1c82759bb
|
extend playlist_id with metadata and links
|
2021-11-12 15:01:39 +07:00 |
|
simon
|
3485f9b1c8
|
define playlist field types in index
|
2021-11-11 20:57:28 +07:00 |
|
simon
|
c499a130da
|
add sync playlist meta data and position to video index
|
2021-11-11 17:56:29 +07:00 |
|
simon
|
5ef9c5b059
|
download playlist artwork
|
2021-11-10 17:55:34 +07:00 |
|
simon
|
eaf107d0d2
|
add new ta_playlist index and task to find playlists of channel
|
2021-11-08 14:54:17 +07:00 |
|
simon
|
bd37b653c2
|
extend playlists to get all playlists of a channel and upload single playlist to index
|
2021-11-06 22:30:39 +07:00 |
|
simon
|
15845da3a8
|
use check_formats to validate thumb url, #83
|
2021-11-06 20:23:59 +07:00 |
|
simon
|
72bc6a4d02
|
basic methods of YoutubePlaylist class
|
2021-11-05 16:24:05 +07:00 |
|
simon
|
b2a4f88980
|
add re_sync_thumbs to frontend
|
2021-11-01 16:42:07 +07:00 |
|
simon
|
1f0e305527
|
add re_sync_thumbs backend functionality
|
2021-11-01 16:20:21 +07:00 |
|
simon
|
283a72308e
|
handle deleting channel without videos
|
2021-10-31 17:30:29 +07:00 |
|
simon
|
164ee5c523
|
more valueerrors in url extraction
|
2021-10-31 17:05:13 +07:00 |
|
simon
|
1ba3090db1
|
rewrite url_str extractor to convert channel names into channel ids, #40
|
2021-10-31 16:04:28 +07:00 |
|
simon
|
caff9ce189
|
standardize parse_url_list to only return ids
|
2021-10-30 17:51:50 +07:00 |
|
simon
|
cc90e437a9
|
show progress message for thumbnail download
|
2021-10-30 17:06:54 +07:00 |
|
simon
|
29fc5fbda2
|
improved progress message for frontend feedback
|
2021-10-30 17:06:22 +07:00 |
|
simon
|
20aab04fbf
|
fix keyerror
|
2021-10-30 16:35:10 +07:00 |
|
simon
|
a8ded25b35
|
userspace color
|
2021-10-29 23:43:19 +07:00 |
|
simon
|
a4397b5204
|
validate settings form and userspace archive page_size
|
2021-10-29 22:37:31 +07:00 |