Register - Login
Views: 99393369
 Main - Memberlist - Active users - Calendar - Wiki - IRC Chat - Online users
Ranks - Rules/FAQ - Stats - Latest Posts - Color Chart - Smilies		 04-24-22 10:24:52 AM
Jul - Meta - Search indexing New poll - New thread - New reply
Pages: 1 2 Next newer thread | Next older thread
Xkeeper

Level: 263


Posts: 23358/25343
EXP: 296722336
For next: 2238117

Since: 07-03-07

Pronouns: they/them/????????

Since last post: 9 days
Last activity: 3 days
Posted on 09-11-18 05:15:11 PM Link | Quote
robots.txt and the wayback machine

I heard they were ignoring it for government-related websites, but were not actually ignoring it on a general scale at this time. As far as I know, that's been the status for two years at this point.

____________________
(Lv 244 with 228260254 EXP)
Sanqui
2060
💛🤍💜🖤🦉
Level: 87


Posts: 1747/2066
EXP: 6305069
For next: 87705

Since: 12-20-09

Pronouns: any ✨
From: Czechia | Estonia

Since last post: 6 days
Last activity: 1 day
Posted on 09-12-18 07:26:45 PM Link | Quote


*Sanqui flops, wings involved.

level 77

exp 4123135

exppct 63.3%

numposts 1747

 
My reflex was to be opposed to this change. Then I thought "well maybe threads made in the past year could be indexed?". But ultimately, I think I end up being in favor. It's definitely something worth thinking about. What an interesting time.

As for IA, I can always archive the whole of jul with archivebot which ignores robots.txt, ifneedbe

____________________
In our brief lives,  •  we've managed to meet.  •  Treasure this gift,  •  this precious time that we have.        
Sanqui
2060
💛🤍💜🖤🦉
Level: 87


Posts: 1748/2066
EXP: 6305069
For next: 87705

Since: 12-20-09

Pronouns: any ✨
From: Czechia | Estonia

Since last post: 6 days
Last activity: 1 day
Posted on 09-12-18 07:42:30 PM Link | Quote


*Sanqui flops, wings involved.

level 77

exp 4126683

exppct 65.2%

numposts 1748

 
I am proud to be a part of a forum that is now unplugged. Delisted. Unindexed. Our own little hidden island in the terrible ocean of Google.

____________________
In our brief lives,  •  we've managed to meet.  •  Treasure this gift,  •  this precious time that we have.        
Xkeeper

Level: 263


Posts: 23358/25343
EXP: 296722336
For next: 2238117

Since: 07-03-07

Pronouns: they/them/????????

Since last post: 9 days
Last activity: 3 days
Posted on 09-12-18 07:48:20 PM Link | Quote
Originally posted by Sanqui
My reflex was to be opposed to this change. Then I thought "well maybe threads made in the past year could be indexed?". But ultimately, I think I end up being in favor. It's definitely something worth thinking about. What an interesting time.

As for IA, I can always archive the whole of jul with archivebot which ignores robots.txt, ifneedbe

At that point I'd sooner just provide an archive of the database, but with certain things scrubbed. Private messages, passwords, restricted forums -- basically stuff that isn't public anyway. (But I'd only want it in trusted hands, not publicly searchable, otherwise it kind of defeats the point.)

____________________
(Lv 244 with 228291136 EXP)
Sanqui
2060
💛🤍💜🖤🦉
Level: 87


Posts: 1749/2066
EXP: 6305069
For next: 87705

Since: 12-20-09

Pronouns: any ✨
From: Czechia | Estonia

Since last post: 6 days
Last activity: 1 day
Posted on 09-12-18 08:02:44 PM Link | Quote


*Sanqui flops, wings involved.

level 77

exp 4130234

exppct 67.1%

numposts 1749

 
Who joins after finding this board from Google, anyway?! I joined through a forum signature and I'm sure most people join by the word of mouth -- most recent influxes being from Twitter and Mastodon advertising. I say out with the late search engine

____________________
In our brief lives,  •  we've managed to meet.  •  Treasure this gift,  •  this precious time that we have.        
sofi

🌠
Level: 116


Posts: 3814/4152
EXP: 17094808
For next: 229285

Since: 02-18-11

Pronouns: she/her
From: たまごっち星

Since last post: 1 day
Last activity: 9 hours
Posted on 09-12-18 11:14:31 PM Link | Quote
i think you did the right thing tbh

i had to go through and delete or edit several old posts because of sensitive information they contained. i used to openly talk about some incredibly personal things here and people could find it if they searched

____________________
 sofi 

※ please excuse our appearance as we prepare for a new layout
Rambly

Level: 106


Posts: 1987/3083
EXP: 12567008
For next: 104935

Since: 07-22-07

Pronouns: she/her

Since last post: 270 days
Last activity: 253 days
Posted on 09-12-18 11:52:59 PM Link | Quote
are we deep web now



honestly i never felt comfortable being fully open about myself here because i knew it was all indexed on google, so i wholeheartedly approve this change. probably won't change my habits, but it's still a good measure

...i didn't use google to search very often anyway; usually i'll literally just go back on thread listings to around the time i think something was posted and ctrl+f for the thread i'm looking for

not exactly the most, uh. efficient means of searching. but it works well enough for the times i need something specific from long past, which isn't often

____________________
Xkeeper

Level: 263


Posts: 23358/25343
EXP: 296722336
For next: 2238117

Since: 07-03-07

Pronouns: they/them/????????

Since last post: 9 days
Last activity: 3 days
Posted on 09-13-18 02:21:13 AM Link | Quote
Goog and friends are still crawling (because in a twist of utter irony, you have to let them crawl pages to know that they aren't supposed to crawl pages, what the hell) but they should no longer save, index, or cache anything. Probably.

I'm blocking other bots as I run across them, because there's an awful lot of misbehaving ones out there.

____________________
(Lv 244 with 228298752 EXP)
Pages: 1 2 Next newer thread | Next older thread
Jul - Meta - Search indexing New poll - New thread - New reply


Rusted Logic
Acmlmboard - commit 47be4dc [2021-08-23]
©2000-2022 Acmlm, Xkeeper, Kaito Sinclaire, et al.

26 database queries.
Query execution time:  0.088146 seconds
Script execution time:  0.022846 seconds
Total render time:  0.110992 seconds


TidyHTML vomit below
line 1 column 1 - Warning: missing <!DOCTYPE> declaration
line 119 column 11 - Warning: <form> isn't allowed in <table> elements
line 118 column 10 - Info: <table> previously mentioned
line 120 column 11 - Warning: missing <tr>
line 120 column 119 - Warning: missing </font> before </td>
line 124 column 16 - Warning: plain text isn't allowed in <tr> elements
line 120 column 11 - Info: <tr> previously mentioned
line 125 column 68 - Warning: missing </nobr> before </td>
line 141 column 68 - Warning: missing </nobr> before <tr>
line 147 column 35 - Warning: missing <tr>
line 147 column 50 - Warning: missing </font> before </td>
line 148 column 37 - Warning: unescaped & or unknown entity "&id"
line 147 column 168 - Warning: missing </font> before </table>
line 149 column 35 - Warning: missing <tr>
line 149 column 95 - Warning: unescaped & or unknown entity "&page"
line 149 column 50 - Warning: missing </font> before </td>
line 149 column 132 - Warning: missing </font> before </table>
line 156 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 158 column 9 - Warning: missing <tr>
line 176 column 13 - Warning: missing <tr>
line 177 column 102 - Warning: unescaped & or unknown entity "&postid"
line 179 column 74 - Warning: <style> isn't allowed in <td> elements
line 179 column 9 - Info: <td> previously mentioned
line 183 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 185 column 9 - Warning: missing <tr>
line 203 column 13 - Warning: missing <tr>
line 204 column 102 - Warning: unescaped & or unknown entity "&postid"
line 206 column 74 - Warning: <style> isn't allowed in <td> elements
line 206 column 9 - Info: <td> previously mentioned
line 206 column 613 - Warning: <style> isn't allowed in <td> elements
line 206 column 9 - Info: <td> previously mentioned
line 206 column 3831 - Warning: '<' + '/' + letter not allowed here
line 211 column 20 - Warning: '<' + '/' + letter not allowed here
line 211 column 34 - Warning: '<' + '/' + letter not allowed here
line 215 column 21 - Warning: '<' + '/' + letter not allowed here
line 230 column 1023 - Warning: discarding unexpected </div>
line 230 column 1029 - Warning: discarding unexpected </div>
line 230 column 1035 - Warning: discarding unexpected </td>
line 233 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 235 column 9 - Warning: missing <tr>
line 253 column 13 - Warning: missing <tr>
line 254 column 102 - Warning: unescaped & or unknown entity "&postid"
line 256 column 74 - Warning: <style> isn't allowed in <td> elements
line 256 column 9 - Info: <td> previously mentioned
line 256 column 613 - Warning: <style> isn't allowed in <td> elements
line 256 column 9 - Info: <td> previously mentioned
line 256 column 3831 - Warning: '<' + '/' + letter not allowed here
line 261 column 20 - Warning: '<' + '/' + letter not allowed here
line 261 column 34 - Warning: '<' + '/' + letter not allowed here
line 265 column 21 - Warning: '<' + '/' + letter not allowed here
line 278 column 826 - Warning: discarding unexpected </div>
line 278 column 832 - Warning: discarding unexpected </div>
line 278 column 838 - Warning: discarding unexpected </td>
line 281 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 283 column 9 - Warning: missing <tr>
line 301 column 13 - Warning: missing <tr>
line 302 column 102 - Warning: unescaped & or unknown entity "&postid"
line 304 column 74 - Warning: <style> isn't allowed in <td> elements
line 304 column 9 - Info: <td> previously mentioned
line 310 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 312 column 9 - Warning: missing <tr>
line 330 column 13 - Warning: missing <tr>
line 331 column 102 - Warning: unescaped & or unknown entity "&postid"
line 333 column 74 - Warning: <style> isn't allowed in <td> elements
line 333 column 9 - Info: <td> previously mentioned
line 333 column 613 - Warning: <style> isn't allowed in <td> elements
line 333 column 9 - Info: <td> previously mentioned
line 333 column 3831 - Warning: '<' + '/' + letter not allowed here
line 338 column 20 - Warning: '<' + '/' + letter not allowed here
line 338 column 34 - Warning: '<' + '/' + letter not allowed here
line 342 column 21 - Warning: '<' + '/' + letter not allowed here
line 355 column 920 - Warning: discarding unexpected </div>
line 355 column 926 - Warning: discarding unexpected </div>
line 355 column 932 - Warning: discarding unexpected </td>
line 358 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 360 column 9 - Warning: missing <tr>
line 378 column 13 - Warning: missing <tr>
line 379 column 102 - Warning: unescaped & or unknown entity "&postid"
line 381 column 74 - Warning: <style> isn't allowed in <td> elements
line 381 column 9 - Info: <td> previously mentioned
line 388 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 390 column 9 - Warning: missing <tr>
line 408 column 13 - Warning: missing <tr>
line 409 column 102 - Warning: unescaped & or unknown entity "&postid"
line 411 column 74 - Warning: <style> isn't allowed in <td> elements
line 411 column 9 - Info: <td> previously mentioned
line 422 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 424 column 9 - Warning: missing <tr>
line 442 column 13 - Warning: missing <tr>
line 443 column 102 - Warning: unescaped & or unknown entity "&postid"
line 445 column 74 - Warning: <style> isn't allowed in <td> elements
line 445 column 9 - Info: <td> previously mentioned
line 450 column 17 - Warning: missing <tr>
line 450 column 17 - Warning: discarding unexpected <table>
line 453 column 35 - Warning: missing <tr>
line 453 column 95 - Warning: unescaped & or unknown entity "&page"
line 453 column 50 - Warning: missing </font> before </td>
line 453 column 132 - Warning: missing </font> before </table>
line 455 column 35 - Warning: missing <tr>
line 455 column 50 - Warning: missing </font> before </td>
line 456 column 37 - Warning: unescaped & or unknown entity "&id"
line 455 column 168 - Warning: missing </font> before </table>
line 457 column 17 - Warning: discarding unexpected </textarea>
line 457 column 28 - Warning: discarding unexpected </form>
line 457 column 35 - Warning: discarding unexpected </embed>
line 457 column 43 - Warning: discarding unexpected </noembed>
line 457 column 53 - Warning: discarding unexpected </noscript>
line 457 column 64 - Warning: discarding unexpected </noembed>
line 457 column 74 - Warning: discarding unexpected </embed>
line 457 column 82 - Warning: discarding unexpected </table>
line 457 column 90 - Warning: discarding unexpected </table>
line 459 column 9 - Warning: missing </font> before <table>
line 471 column 25 - Warning: discarding unexpected </font>
line 480 column 37 - Warning: discarding unexpected </font>
line 458 column 1 - Warning: missing </center>
line 120 column 63 - Warning: <img> lacks "alt" attribute
line 125 column 19 - Warning: <td> attribute "width" has invalid value "120px"
line 125 column 93 - Warning: <img> lacks "alt" attribute
line 141 column 19 - Warning: <td> attribute "width" has invalid value "120px"
line 141 column 98 - Warning: <img> lacks "alt" attribute
line 148 column 44 - Warning: <img> proprietary attribute value "absmiddle"
line 148 column 142 - Warning: <img> proprietary attribute value "absmiddle"
line 148 column 246 - Warning: <img> proprietary attribute value "absmiddle"
line 161 column 23 - Warning: <img> lacks "alt" attribute
line 161 column 64 - Warning: <img> lacks "alt" attribute
line 161 column 113 - Warning: <img> lacks "alt" attribute
line 161 column 163 - Warning: <img> lacks "alt" attribute
line 162 column 11 - Warning: <img> lacks "alt" attribute
line 172 column 15 - Warning: <img> lacks "alt" attribute
line 187 column 16 - Warning: <img> proprietary attribute value "absmiddle"
line 187 column 16 - Warning: <img> lacks "alt" attribute
line 187 column 59 - Warning: <img> proprietary attribute value "absmiddle"
line 187 column 59 - Warning: <img> lacks "alt" attribute
line 187 column 102 - Warning: <img> proprietary attribute value "absmiddle"
line 187 column 102 - Warning: <img> lacks "alt" attribute
line 187 column 145 - Warning: <img> proprietary attribute value "absmiddle"
line 187 column 145 - Warning: <img> lacks "alt" attribute
line 188 column 22 - Warning: <img> lacks "alt" attribute
line 188 column 63 - Warning: <img> lacks "alt" attribute
line 188 column 112 - Warning: <img> lacks "alt" attribute
line 188 column 162 - Warning: <img> lacks "alt" attribute
line 189 column 11 - Warning: <img> lacks "alt" attribute
line 199 column 15 - Warning: <img> lacks "alt" attribute
line 237 column 16 - Warning: <img> proprietary attribute value "absmiddle"
line 237 column 16 - Warning: <img> lacks "alt" attribute
line 237 column 59 - Warning: <img> proprietary attribute value "absmiddle"
line 237 column 59 - Warning: <img> lacks "alt" attribute
line 237 column 102 - Warning: <img> proprietary attribute value "absmiddle"
line 237 column 102 - Warning: <img> lacks "alt" attribute
line 237 column 145 - Warning: <img> proprietary attribute value "absmiddle"
line 237 column 145 - Warning: <img> lacks "alt" attribute
line 238 column 22 - Warning: <img> lacks "alt" attribute
line 238 column 63 - Warning: <img> lacks "alt" attribute
line 238 column 112 - Warning: <img> lacks "alt" attribute
line 238 column 162 - Warning: <img> lacks "alt" attribute
line 239 column 11 - Warning: <img> lacks "alt" attribute
line 249 column 15 - Warning: <img> lacks "alt" attribute
line 286 column 23 - Warning: <img> lacks "alt" attribute
line 286 column 64 - Warning: <img> lacks "alt" attribute
line 286 column 113 - Warning: <img> lacks "alt" attribute
line 286 column 163 - Warning: <img> lacks "alt" attribute
line 287 column 11 - Warning: <img> lacks "alt" attribute
line 297 column 15 - Warning: <img> lacks "alt" attribute
line 304 column 901 - Warning: <div> anchor "xklayout" already defined
line 314 column 16 - Warning: <img> proprietary attribute value "absmiddle"
line 314 column 16 - Warning: <img> lacks "alt" attribute
line 314 column 59 - Warning: <img> proprietary attribute value "absmiddle"
line 314 column 59 - Warning: <img> lacks "alt" attribute
line 314 column 102 - Warning: <img> proprietary attribute value "absmiddle"
line 314 column 102 - Warning: <img> lacks "alt" attribute
line 314 column 145 - Warning: <img> proprietary attribute value "absmiddle"
line 314 column 145 - Warning: <img> lacks "alt" attribute
line 315 column 22 - Warning: <img> lacks "alt" attribute
line 315 column 63 - Warning: <img> lacks "alt" attribute
line 315 column 112 - Warning: <img> lacks "alt" attribute
line 315 column 162 - Warning: <img> lacks "alt" attribute
line 316 column 11 - Warning: <img> lacks "alt" attribute
line 326 column 15 - Warning: <img> lacks "alt" attribute
line 362 column 11 - Warning: <img> lacks "alt" attribute
line 363 column 23 - Warning: <img> lacks "alt" attribute
line 363 column 64 - Warning: <img> lacks "alt" attribute
line 363 column 113 - Warning: <img> lacks "alt" attribute
line 363 column 163 - Warning: <img> lacks "alt" attribute
line 364 column 11 - Warning: <img> lacks "alt" attribute
line 374 column 15 - Warning: <img> lacks "alt" attribute
line 392 column 11 - Warning: <img> lacks "alt" attribute
line 393 column 23 - Warning: <img> lacks "alt" attribute
line 393 column 64 - Warning: <img> lacks "alt" attribute
line 393 column 113 - Warning: <img> lacks "alt" attribute
line 393 column 163 - Warning: <img> lacks "alt" attribute
line 394 column 11 - Warning: <img> lacks "alt" attribute
line 404 column 15 - Warning: <img> lacks "alt" attribute
line 427 column 23 - Warning: <img> lacks "alt" attribute
line 427 column 64 - Warning: <img> lacks "alt" attribute
line 427 column 113 - Warning: <img> lacks "alt" attribute
line 427 column 163 - Warning: <img> lacks "alt" attribute
line 428 column 11 - Warning: <img> lacks "alt" attribute
line 438 column 15 - Warning: <img> lacks "alt" attribute
line 445 column 901 - Warning: <div> anchor "xklayout" already defined
line 456 column 44 - Warning: <img> proprietary attribute value "absmiddle"
line 456 column 142 - Warning: <img> proprietary attribute value "absmiddle"
line 456 column 246 - Warning: <img> proprietary attribute value "absmiddle"
line 465 column 25 - Warning: <img> lacks "alt" attribute
line 470 column 267 - Warning: <img> lacks "alt" attribute
line 450 column 17 - Warning: trimming empty <tr>
line 125 column 68 - Warning: <nobr> is not approved by W3C
line 141 column 68 - Warning: <nobr> is not approved by W3C
line 177 column 27 - Warning: <nobr> is not approved by W3C
line 204 column 27 - Warning: <nobr> is not approved by W3C
line 254 column 27 - Warning: <nobr> is not approved by W3C
line 302 column 27 - Warning: <nobr> is not approved by W3C
line 331 column 27 - Warning: <nobr> is not approved by W3C
line 379 column 27 - Warning: <nobr> is not approved by W3C
line 409 column 27 - Warning: <nobr> is not approved by W3C
line 443 column 27 - Warning: <nobr> is not approved by W3C
Info: Document content looks like HTML5
Info: No system identifier in emitted doctype
Tidy found 202 warnings and 0 errors!


The alt attribute should be used to give a short description
of an image; longer descriptions should be given with the
longdesc attribute which takes a URL linked to the description.
These measures are needed for people using non-graphical browsers.

For further advice on how to make your pages accessible
see http://www.w3.org/WAI/GL.
You are recommended to use CSS to specify the font and
properties such as its size and color. This will reduce
the size of HTML files and make them easier to maintain
compared with using <FONT> elements.

You are recommended to use CSS to control line wrapping.
Use "white-space: nowrap" to inhibit wrapping in place
of inserting <NOBR>...</NOBR> into the markup.

About HTML Tidy: https://github.com/htacg/tidy-html5
Bug reports and comments: https://github.com/htacg/tidy-html5/issues
Official mailing list: https://lists.w3.org/Archives/Public/public-htacg/
Latest HTML specification: http://dev.w3.org/html5/spec-author-view/
Validate your HTML documents: http://validator.w3.org/nu/
Lobby your company to join the W3C: http://www.w3.org/Consortium

Do you speak a language other than English, or a different variant of
English? Consider helping us to localize HTML Tidy. For details please see
https://github.com/htacg/tidy-html5/blob/master/README/LOCALIZE.md