Register - Login
Views: 99392635
 Main - Memberlist - Active users - Calendar - Wiki - IRC Chat - Online users
Ranks - Rules/FAQ - Stats - Latest Posts - Color Chart - Smilies		 04-24-22 10:12:00 AM
Jul - The Cutting Room Floor - Unlisted Youtube videos are about to become private New poll - New thread - New reply
Next newer thread | Next older thread
trumad
Random nobody
Level: 3


Posts: 1/2
EXP: 47
For next: 81

Since: 07-14-21


Since last post: 284 days
Last activity: 261 days
Posted on 07-14-21 02:02:35 AM Link | Quote
I'm sure you've seen this news: https://9to5google.com/2021/06/23/youtube-unlisted-videos/

This means that most of the 250 or so unlisted videos linked/embedded on TCRF will become broken links overnight. Is there already a plan in place to fix this?

Just in case there isn't, I am currently downloading all of these to a hard drive. Ideally I'll be able to mirror them somewhere, like maybe the Internet Archive, and then edit the various wiki articles to point to these new video urls.

Can someone in charge confirm that this is ok, or that you are already on top of this? If I'm to do it, is there an official youtube channel where you'd like the videos uploaded? Is there a quick & easy way to edit articles to fix these links, or do I need to craft my own bot? I would very much like to work with someone on the TCRF team to get this done quickly, since the videos will go private in a matter of days.
Sanqui
2060
💛🤍💜🖤🦉
Level: 87


Posts: 1957/2066
EXP: 6305063
For next: 87711

Since: 12-20-09

Pronouns: any ✨
From: Czechia | Estonia

Since last post: 6 days
Last activity: 1 day
Posted on 07-14-21 08:44:55 AM Link | Quote


* flops, wings involved.

level 84

exp 5626615

exppct 84.6%

numposts 1957

 
No I don't think we have a contingency plan for this, although I'm not on top of things. It would be of great help if you or somebody else made a backup. Maybe we could grep the database for youtube links to make this easier, then we could just pipe that to youtube-dl...

____________________
In our brief lives,  •  we've managed to meet.  •  Treasure this gift,  •  this precious time that we have.        
✨ Fuck the cynicism, let the colors fly
Don't care you think it's cringe, because it's not your life~ 🎶
trumad
Random nobody
Level: 3


Posts: 2/2
EXP: 47
For next: 81

Since: 07-14-21


Since last post: 284 days
Last activity: 261 days
Posted on 07-14-21 09:05:08 AM Link | Quote
Cool. I grabbed them - it was faster than I thought. Lots of short videos, around 7gb total.

I scraped the site (single-threaded) and parsed out all 6586 youtube links/embeds. Then I used this tool to check which videos specifically are unlisted and uploaded before 2017: https://sgeo.github.io/youtube-at-risk/

That left me with 250 videos which I've backed up. Just need to decide where to mirror them. I'm chatting in the Discord also, so hopefully we can find a way to fix the soon-to-break videos site-wide.

If there are a ton of videos I missed that somebody could find by grepping the database, I'd love to re-do it and make sure we have the whole collection!
Next newer thread | Next older thread
Jul - The Cutting Room Floor - Unlisted Youtube videos are about to become private New poll - New thread - New reply


Rusted Logic
Acmlmboard - commit 47be4dc [2021-08-23]
©2000-2022 Acmlm, Xkeeper, Kaito Sinclaire, et al.

28 database queries, 1 query cache hits.
Query execution time:  0.078317 seconds
Script execution time:  0.008556 seconds
Total render time:  0.086873 seconds


TidyHTML vomit below
line 1 column 1 - Warning: missing <!DOCTYPE> declaration
line 2 column 301 - Warning: unescaped & or unknown entity "&page"
line 119 column 11 - Warning: <form> isn't allowed in <table> elements
line 118 column 10 - Info: <table> previously mentioned
line 120 column 11 - Warning: missing <tr>
line 120 column 119 - Warning: missing </font> before </td>
line 124 column 16 - Warning: plain text isn't allowed in <tr> elements
line 120 column 11 - Info: <tr> previously mentioned
line 125 column 68 - Warning: missing </nobr> before </td>
line 141 column 68 - Warning: missing </nobr> before <tr>
line 147 column 35 - Warning: missing <tr>
line 147 column 50 - Warning: missing </font> before </td>
line 148 column 37 - Warning: unescaped & or unknown entity "&id"
line 147 column 222 - Warning: missing </font> before </table>
line 149 column 35 - Warning: missing <tr>
line 149 column 50 - Warning: missing </font> before </td>
line 149 column 91 - Warning: missing </font> before </table>
line 156 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 158 column 9 - Warning: missing <tr>
line 176 column 13 - Warning: missing <tr>
line 177 column 102 - Warning: unescaped & or unknown entity "&postid"
line 188 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 190 column 9 - Warning: missing <tr>
line 208 column 13 - Warning: missing <tr>
line 209 column 102 - Warning: unescaped & or unknown entity "&postid"
line 211 column 74 - Warning: <style> isn't allowed in <td> elements
line 211 column 9 - Info: <td> previously mentioned
line 211 column 613 - Warning: <style> isn't allowed in <td> elements
line 211 column 9 - Info: <td> previously mentioned
line 211 column 3813 - Warning: '<' + '/' + letter not allowed here
line 216 column 20 - Warning: '<' + '/' + letter not allowed here
line 216 column 34 - Warning: '<' + '/' + letter not allowed here
line 220 column 21 - Warning: '<' + '/' + letter not allowed here
line 234 column 1090 - Warning: discarding unexpected </div>
line 234 column 1096 - Warning: discarding unexpected </div>
line 234 column 1102 - Warning: discarding unexpected </td>
line 237 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 239 column 9 - Warning: missing <tr>
line 257 column 13 - Warning: missing <tr>
line 258 column 102 - Warning: unescaped & or unknown entity "&postid"
line 269 column 17 - Warning: missing <tr>
line 269 column 17 - Warning: discarding unexpected <table>
line 272 column 35 - Warning: missing <tr>
line 272 column 50 - Warning: missing </font> before </td>
line 272 column 91 - Warning: missing </font> before </table>
line 274 column 35 - Warning: missing <tr>
line 274 column 50 - Warning: missing </font> before </td>
line 275 column 37 - Warning: unescaped & or unknown entity "&id"
line 274 column 222 - Warning: missing </font> before </table>
line 276 column 17 - Warning: discarding unexpected </textarea>
line 276 column 28 - Warning: discarding unexpected </form>
line 276 column 35 - Warning: discarding unexpected </embed>
line 276 column 43 - Warning: discarding unexpected </noembed>
line 276 column 53 - Warning: discarding unexpected </noscript>
line 276 column 64 - Warning: discarding unexpected </noembed>
line 276 column 74 - Warning: discarding unexpected </embed>
line 276 column 82 - Warning: discarding unexpected </table>
line 276 column 90 - Warning: discarding unexpected </table>
line 278 column 9 - Warning: missing </font> before <table>
line 290 column 25 - Warning: discarding unexpected </font>
line 299 column 57 - Warning: discarding unexpected </font>
line 277 column 1 - Warning: missing </center>
line 120 column 63 - Warning: <img> lacks "alt" attribute
line 125 column 19 - Warning: <td> attribute "width" has invalid value "120px"
line 125 column 93 - Warning: <img> lacks "alt" attribute
line 141 column 19 - Warning: <td> attribute "width" has invalid value "120px"
line 141 column 98 - Warning: <img> lacks "alt" attribute
line 148 column 44 - Warning: <img> proprietary attribute value "absmiddle"
line 148 column 142 - Warning: <img> proprietary attribute value "absmiddle"
line 148 column 246 - Warning: <img> proprietary attribute value "absmiddle"
line 161 column 21 - Warning: <img> lacks "alt" attribute
line 161 column 62 - Warning: <img> lacks "alt" attribute
line 161 column 110 - Warning: <img> lacks "alt" attribute
line 161 column 160 - Warning: <img> lacks "alt" attribute
line 172 column 15 - Warning: <img> lacks "alt" attribute
line 192 column 16 - Warning: <img> proprietary attribute value "absmiddle"
line 192 column 16 - Warning: <img> lacks "alt" attribute
line 192 column 59 - Warning: <img> proprietary attribute value "absmiddle"
line 192 column 59 - Warning: <img> lacks "alt" attribute
line 192 column 102 - Warning: <img> proprietary attribute value "absmiddle"
line 192 column 102 - Warning: <img> lacks "alt" attribute
line 192 column 145 - Warning: <img> proprietary attribute value "absmiddle"
line 192 column 145 - Warning: <img> lacks "alt" attribute
line 193 column 22 - Warning: <img> lacks "alt" attribute
line 193 column 63 - Warning: <img> lacks "alt" attribute
line 193 column 112 - Warning: <img> lacks "alt" attribute
line 193 column 162 - Warning: <img> lacks "alt" attribute
line 194 column 11 - Warning: <img> lacks "alt" attribute
line 204 column 15 - Warning: <img> lacks "alt" attribute
line 242 column 21 - Warning: <img> lacks "alt" attribute
line 242 column 62 - Warning: <img> lacks "alt" attribute
line 242 column 110 - Warning: <img> lacks "alt" attribute
line 242 column 160 - Warning: <img> lacks "alt" attribute
line 253 column 15 - Warning: <img> lacks "alt" attribute
line 275 column 44 - Warning: <img> proprietary attribute value "absmiddle"
line 275 column 142 - Warning: <img> proprietary attribute value "absmiddle"
line 275 column 246 - Warning: <img> proprietary attribute value "absmiddle"
line 284 column 25 - Warning: <img> lacks "alt" attribute
line 289 column 267 - Warning: <img> lacks "alt" attribute
line 149 column 50 - Warning: trimming empty <font>
line 222 column 18 - Warning: trimming empty <b>
line 269 column 17 - Warning: trimming empty <tr>
line 272 column 50 - Warning: trimming empty <font>
line 125 column 68 - Warning: <nobr> is not approved by W3C
line 141 column 68 - Warning: <nobr> is not approved by W3C
line 177 column 27 - Warning: <nobr> is not approved by W3C
line 209 column 27 - Warning: <nobr> is not approved by W3C
line 258 column 27 - Warning: <nobr> is not approved by W3C
Info: Document content looks like HTML5
Info: No system identifier in emitted doctype
Tidy found 104 warnings and 0 errors!


The alt attribute should be used to give a short description
of an image; longer descriptions should be given with the
longdesc attribute which takes a URL linked to the description.
These measures are needed for people using non-graphical browsers.

For further advice on how to make your pages accessible
see http://www.w3.org/WAI/GL.
You are recommended to use CSS to specify the font and
properties such as its size and color. This will reduce
the size of HTML files and make them easier to maintain
compared with using <FONT> elements.

You are recommended to use CSS to control line wrapping.
Use "white-space: nowrap" to inhibit wrapping in place
of inserting <NOBR>...</NOBR> into the markup.

About HTML Tidy: https://github.com/htacg/tidy-html5
Bug reports and comments: https://github.com/htacg/tidy-html5/issues
Official mailing list: https://lists.w3.org/Archives/Public/public-htacg/
Latest HTML specification: http://dev.w3.org/html5/spec-author-view/
Validate your HTML documents: http://validator.w3.org/nu/
Lobby your company to join the W3C: http://www.w3.org/Consortium

Do you speak a language other than English, or a different variant of
English? Consider helping us to localize HTML Tidy. For details please see
https://github.com/htacg/tidy-html5/blob/master/README/LOCALIZE.md