Register - Login
Views: 99384431
Main - Memberlist - Active users - Calendar - Wiki - IRC Chat - Online users
Ranks - Rules/FAQ - Stats - Latest Posts - Color Chart - Smilies
04-24-22 03:04:45 AM
Jul - The Cutting Room Floor - Miitomo is shutting down May 9th New poll - New thread - New reply
Next newer thread | Next older thread
rabidabid
Member
Level: 27


Posts: 115/135
EXP: 102368
For next: 13791

Since: 08-25-10


Since last post: 24 days
Last activity: 6 days

Posted on 04-30-18 12:00:32 PM (last edited by rabidabid at 05-08-18 03:19:42 PM) Link | Quote
Nintendo announced back in January it was shutting down Miitomo on May 9th. I know, it wasn't very popular, and it's not really a "game", but I figure Nintendo's first smartphone app is worth some sort of archiving effort.

The majority of customization assets (clothes/wallpapers/flooring/etc.) are stored on Nintendo's servers and are downloaded to the app as needed. So once the app shuts down, all of that will probably disappear too.

I used a packet capturer to try and sniff out where the data is coming from. The model assets seem to come from zip files stored on "download-cdn.miitomo.com". ("api.miitomo.com" is another URL where... stuff comes from.) Here's some samples:



http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_character_bodyAcce_output_bodyAcce0000.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_character_bodyAll_output_bodyAll0000.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_character_bodyBottomsA_output_bodyBottomsA0000.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_character_bodyBottomsB_output_bodyBottomsB0000.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_character_bodyShoes_output_bodyShoes0000.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_character_bodyTops_output_bodyTops0000.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_character_bodyTopslong_output_bodyTopslong0000.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_character_headwear_output_headwear0000.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_room_roomFloor_output_rmFl0000.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_model_room_roomWall_output_rmWl0000.zip


(Replace the "android" with "ios" for the iOS assets.)

I've tried manually downloading stuff by going through the numbers but, um... there's a lot. The shirt numbers alone go up to at least 1000. But a lot of those numbers just don't exist? For example, "headwear0066" through "headwear0099" don't seem to work... but "headwear0100" does... but other numbers going up from there don't... but "headwear0211" does... etc.

It'd be nice to be able to just crawl the whole thing, but I've gotten 403 errors trying that.

- - -

The textures are PVR 3.0, ETC1 encoded (via GerbilSoft). I managed to open them with something called PVRTexTool, but there might be something else out there.

Here's some random examples:







- - -

And here's some other random URLs I picked up:


http://download-cdn.miitomo.com/native/20180125111639/manifests/v2_20180405_3_android/manifest.json

http://download-cdn.miitomo.com/native/20180125111639/android/v2/sound.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_archCamera_cameraBg_default.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/20170608va04ga91webp.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_corinthGameBanner2_200820.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/asset_shopBanner2_newStandard124_webp.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/message_Release_Arch_msbp.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/message_Release_Console_JPja_EmotionExpression.zip

http://download-cdn.miitomo.com/native/20180125111639/android/v2/stageimg200500.zip


And one that might particularly be TCRF related:

http://download-cdn.miitomo.com/native/20180125111639/android/v2/unused-assets_csv.zip

Dilene
Random nobody
Level: 2


Posts: 1/1
EXP: 38
For next: 8

Since: 05-02-18


Since last post: 4.0 years
Last activity: 3.8 years

Posted on 05-02-18 08:46:23 AM (last edited by Dilene at 05-02-18 08:58:33 AM) Link | Quote
Made the account to chime in (after 6 years of lurking!)

Originally posted by rabidabid



http://download-cdn.miitomo.com/native/20180125111639/manifests/v2_20180405_3_android/manifest.json




manifest.json lists all the files the game downloads, including their MD5 hashes, so a downloader can be made to get all the files ever used by the game regardless of region or platform.

I actually possess such a downloader, and I'm downloading the files as I'm writing the post Got it downloaded. About 762MB of content and assets.

I'm don't really care about Miitomo (tried it a few times but I didn't get the appeal of it, despite logging countless hours on Tomodachi Life), but for the sake of preserving its stuff? I guess I can do something to not let this game be lost to history.
rabidabid
Member
Level: 27


Posts: 116/135
EXP: 102368
For next: 13791

Since: 08-25-10


Since last post: 24 days
Last activity: 6 days

Posted on 05-02-18 11:44:30 AM Link | Quote
Nice. (Also, welcome!) I actually just found the manifest last night. It's quite helpful. There's also one for iOS:

http://download-cdn.miitomo.com/native/20180125111639/manifests/v2_20180405_3_ios/manifest.json


einstein95 parsed out the links and apparently tossed them into ArchiveBot, so... I guess they'll be appearing on the Internet Archive in some form.


[01:36] [eientei95] rabidabid: https://gist.githubusercontent.com/einstein95/76a82c4c985d832b6614b8e17ed7924d/raw/68639ac929bfe9d90b6d251253b85872eaa7b026/ios.txt https://gist.githubusercontent.com/einstein95/76a82c4c985d832b6614b8e17ed7924d/raw/68639ac929bfe9d90b6d251253b85872eaa7b026/android.txt
[01:36] [eientei95] Threw these URLs into archivebot
[01:48] [eientei95] rabidabid: archives done. iOS: 958.2 MiB; Android: 732.6 MiB


I might download them too for the heck of it.
einstein95
Member
Level: 37


Posts: 314/318
EXP: 325757
For next: 12496

Since: 04-11-13


Since last post: 3.3 years
Last activity: 3.3 years

Posted on 05-03-18 07:39:57 PM (last edited by einstein95 at 05-03-18 07:40:11 PM) Link | Quote
Originally posted by rabidabid
einstein95 parsed out the links and apparently tossed them into ArchiveBot, so... I guess they'll be appearing on the Internet Archive in some form.


https://archive.org/download/archiveteam_archivebot_go_20180502130001

The files starting with "urls-gist.githubusercontent.com" are what you want.

____________________
Sometimes I English very well but sometimes no.
Next newer thread | Next older thread
Jul - The Cutting Room Floor - Miitomo is shutting down May 9th New poll - New thread - New reply


Rusted Logic

Acmlmboard - commit 47be4dc [2021-08-23]
©2000-2022 Acmlm, Xkeeper, Kaito Sinclaire, et al.

31 database queries, 1 query cache hits.
Query execution time:  0.101636 seconds
Script execution time:  0.009686 seconds
Total render time:  0.111322 seconds


TidyHTML vomit below
line 1 column 1 - Warning: missing <!DOCTYPE> declaration
line 2 column 301 - Warning: unescaped & or unknown entity "&page"
line 119 column 11 - Warning: <form> isn't allowed in <table> elements
line 118 column 10 - Info: <table> previously mentioned
line 120 column 11 - Warning: missing <tr>
line 120 column 119 - Warning: missing </font> before </td>
line 124 column 16 - Warning: plain text isn't allowed in <tr> elements
line 120 column 11 - Info: <tr> previously mentioned
line 125 column 68 - Warning: missing </nobr> before </td>
line 141 column 68 - Warning: missing </nobr> before <tr>
line 147 column 35 - Warning: missing <tr>
line 147 column 50 - Warning: missing </font> before </td>
line 148 column 37 - Warning: unescaped & or unknown entity "&id"
line 147 column 203 - Warning: missing </font> before </table>
line 149 column 35 - Warning: missing <tr>
line 149 column 50 - Warning: missing </font> before </td>
line 149 column 91 - Warning: missing </font> before </table>
line 156 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 158 column 9 - Warning: missing <tr>
line 176 column 13 - Warning: missing <tr>
line 177 column 102 - Warning: unescaped & or unknown entity "&postid"
line 248 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 250 column 9 - Warning: missing <tr>
line 268 column 13 - Warning: missing <tr>
line 269 column 102 - Warning: unescaped & or unknown entity "&postid"
line 285 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 287 column 9 - Warning: missing <tr>
line 305 column 13 - Warning: missing <tr>
line 306 column 102 - Warning: unescaped & or unknown entity "&postid"
line 321 column 9 - Warning: <div> isn't allowed in <table> elements
line 152 column 17 - Info: <table> previously mentioned
line 323 column 9 - Warning: missing <tr>
line 341 column 13 - Warning: missing <tr>
line 342 column 102 - Warning: unescaped & or unknown entity "&postid"
line 351 column 17 - Warning: missing <tr>
line 351 column 17 - Warning: discarding unexpected <table>
line 354 column 35 - Warning: missing <tr>
line 354 column 50 - Warning: missing </font> before </td>
line 354 column 91 - Warning: missing </font> before </table>
line 356 column 35 - Warning: missing <tr>
line 356 column 50 - Warning: missing </font> before </td>
line 357 column 37 - Warning: unescaped & or unknown entity "&id"
line 356 column 203 - Warning: missing </font> before </table>
line 358 column 17 - Warning: discarding unexpected </textarea>
line 358 column 28 - Warning: discarding unexpected </form>
line 358 column 35 - Warning: discarding unexpected </embed>
line 358 column 43 - Warning: discarding unexpected </noembed>
line 358 column 53 - Warning: discarding unexpected </noscript>
line 358 column 64 - Warning: discarding unexpected </noembed>
line 358 column 74 - Warning: discarding unexpected </embed>
line 358 column 82 - Warning: discarding unexpected </table>
line 358 column 90 - Warning: discarding unexpected </table>
line 360 column 9 - Warning: missing </font> before <table>
line 372 column 25 - Warning: discarding unexpected </font>
line 381 column 57 - Warning: discarding unexpected </font>
line 359 column 1 - Warning: missing </center>
line 120 column 63 - Warning: <img> lacks "alt" attribute
line 125 column 19 - Warning: <td> attribute "width" has invalid value "120px"
line 125 column 93 - Warning: <img> lacks "alt" attribute
line 141 column 19 - Warning: <td> attribute "width" has invalid value "120px"
line 141 column 98 - Warning: <img> lacks "alt" attribute
line 148 column 44 - Warning: <img> proprietary attribute value "absmiddle"
line 148 column 142 - Warning: <img> proprietary attribute value "absmiddle"
line 148 column 246 - Warning: <img> proprietary attribute value "absmiddle"
line 161 column 22 - Warning: <img> lacks "alt" attribute
line 161 column 63 - Warning: <img> lacks "alt" attribute
line 161 column 111 - Warning: <img> lacks "alt" attribute
line 161 column 161 - Warning: <img> lacks "alt" attribute
line 162 column 11 - Warning: <img> lacks "alt" attribute
line 172 column 15 - Warning: <img> lacks "alt" attribute
line 219 column 2886 - Warning: <img> lacks "alt" attribute
line 219 column 2942 - Warning: <img> lacks "alt" attribute
line 219 column 3001 - Warning: <img> lacks "alt" attribute
line 219 column 3061 - Warning: <img> lacks "alt" attribute
line 253 column 21 - Warning: <img> lacks "alt" attribute
line 253 column 62 - Warning: <img> lacks "alt" attribute
line 253 column 111 - Warning: <img> lacks "alt" attribute
line 253 column 161 - Warning: <img> lacks "alt" attribute
line 264 column 15 - Warning: <img> lacks "alt" attribute
line 290 column 22 - Warning: <img> lacks "alt" attribute
line 290 column 63 - Warning: <img> lacks "alt" attribute
line 290 column 111 - Warning: <img> lacks "alt" attribute
line 290 column 161 - Warning: <img> lacks "alt" attribute
line 291 column 11 - Warning: <img> lacks "alt" attribute
line 301 column 15 - Warning: <img> lacks "alt" attribute
line 326 column 22 - Warning: <img> lacks "alt" attribute
line 326 column 63 - Warning: <img> lacks "alt" attribute
line 326 column 112 - Warning: <img> lacks "alt" attribute
line 326 column 162 - Warning: <img> lacks "alt" attribute
line 337 column 15 - Warning: <img> lacks "alt" attribute
line 357 column 44 - Warning: <img> proprietary attribute value "absmiddle"
line 357 column 142 - Warning: <img> proprietary attribute value "absmiddle"
line 357 column 246 - Warning: <img> proprietary attribute value "absmiddle"
line 366 column 25 - Warning: <img> lacks "alt" attribute
line 371 column 267 - Warning: <img> lacks "alt" attribute
line 149 column 50 - Warning: trimming empty <font>
line 351 column 17 - Warning: trimming empty <tr>
line 354 column 50 - Warning: trimming empty <font>
line 125 column 68 - Warning: <nobr> is not approved by W3C
line 141 column 68 - Warning: <nobr> is not approved by W3C
line 177 column 27 - Warning: <nobr> is not approved by W3C
line 269 column 27 - Warning: <nobr> is not approved by W3C
line 306 column 27 - Warning: <nobr> is not approved by W3C
line 342 column 27 - Warning: <nobr> is not approved by W3C
Info: Document content looks like HTML5
Info: No system identifier in emitted doctype
Tidy found 101 warnings and 0 errors!


The alt attribute should be used to give a short description
of an image; longer descriptions should be given with the
longdesc attribute which takes a URL linked to the description.
These measures are needed for people using non-graphical browsers.

For further advice on how to make your pages accessible
see http://www.w3.org/WAI/GL.
You are recommended to use CSS to specify the font and
properties such as its size and color. This will reduce
the size of HTML files and make them easier to maintain
compared with using <FONT> elements.

You are recommended to use CSS to control line wrapping.
Use "white-space: nowrap" to inhibit wrapping in place
of inserting <NOBR>...</NOBR> into the markup.

About HTML Tidy: https://github.com/htacg/tidy-html5
Bug reports and comments: https://github.com/htacg/tidy-html5/issues
Official mailing list: https://lists.w3.org/Archives/Public/public-htacg/
Latest HTML specification: http://dev.w3.org/html5/spec-author-view/
Validate your HTML documents: http://validator.w3.org/nu/
Lobby your company to join the W3C: http://www.w3.org/Consortium

Do you speak a language other than English, or a different variant of
English? Consider helping us to localize HTML Tidy. For details please see
https://github.com/htacg/tidy-html5/blob/master/README/LOCALIZE.md