Category: Games

Posted on
by

Back in December 2024, Niantic posted about a large geospacial model they were building using data from Pokémon Go.

That led to a lot of online talk, with takes ranging from:

  • Well yeah, that’s what we figured they were doing with the “Scan a Pokéstop to build better AR models” feature.
    to
  • Watch out! Niantic is building a global AR model using every image that passes in front of your phone’s camera!

I was in the “of course that’s what it’s for” camp. When the game rolled out the Pokéstop scanning feature a few years earlier, it seemed obvious that it was training 3D machine vision, like how all the “pick the squares with bicycles” CAPTCHAs are obviously training for self-driving cars. I figured there was a good chance someone would use it for some harmful purpose or another, probably surveillance, so I skipped those tasks.

Anyway, after a week or so, Niantic updated the article to clarify* that it was using the deliberate Pokéstop scans in public places for Pokémon Playground, not any of the other AR features like taking a photo of your buddy in the kitchen.

This made sense, because if they were using that data, it would have eventually gotten better at placing a Pokémon in my kitchen. (The floor’s a grid. You’d think that would help, but noooo….)

Drones (And not just Beedrils or Combees)

Those scans are back in the news, because as DroneXL reports, that geospatial model is being used for camera-based drone navigation.

Including military drones.

Because of course everything has to be weaponized. Allegedly even Pixar’s RenderMan.

Admittedly, GPS itself started as a military technology long before it became civilian infrastructure. Military and civilian tech really do just have a revolving door between them, don’t they?

Training Data

Among other sources, DroneXL cites a Dutch-language article at Trouw, who asked the defense contractor (Vantor) directly whether it uses Pokémon Go data: Vantor initially said no, but later walked back any guarantee. Niantic Spatial, however, has stated that the Pokéstop scans were used to train an “early version” of their model. That means the data (or weights produced from it) is still in there, just blended so much by training process that it can’t be identified anymore.

Kind of like you probably couldn’t confirm my old blog posts are in the training data for an LLM by looking at the LLM weights, but you can find pages from hyperborea.org in Common Crawl data, and assume any model trained on Common Crawl still has it in there somewhere.

Maybe scans made since Scopely (US-based, Saudi owned) bought Niantic’s gaming division last year haven’t gone into the map built by Niantic Spatial (still independent), so Vantor technically isn’t using current player data. Or maybe Niantic Games continued passing scans along to Niantic Spatial for a while, under the separate TOS, and Vantor’s spokesperson just hadn’t made the connection.

Quietly Dropped

Curiously, the Pokéstop scanning task I’d left in my list for years just disappeared a few days ago.

At first I deleted the tasks as I got them, but every time I scanned an eligible stop it would add a new one if I didn’t have one in my list. So after a while I just left one there and ignored it like an ad banner.

It turns out Pokémon Go discontinued the features on June 2, just three days before the Trouw article was published. (New tasks stopped appearing that day, and it took a few days for old tasks to disappear.)

Coincidence? Maybe. But the timing’s certainly suspicious.

Notes

* Before Niantic published their update, I e-mailed them asking for clarification. It took them over a month, but they did eventually reply:

Hi Trainer, we appreciate your patience. Thanks for your questions about AR Mode and our Privacy Policy. I’ve shared some additional information below:

For Pokémon GO, only AR scans from the PokéStop Scanning feature will contribute to the development of the Large Geospatial Model. As noted in the PokéStop Scanning Help Article (https://niantic.helpshift.com/hc/en/6-pokemon-go/faq/2519-scanning-a-pokestop/): information gathered during PokéStop Scanning allows Niantic to generate accurate, dynamic 3-D maps of real-world objects and their relative locations, and help devices understand the surroundings in AR real-time. As noted in the Editor’s note to the blog post, merely playing the game does not train an AI model.

When using AR or AR+ mode, we do not store your photos on our servers. For PokéStop Scanning, once a PokéStop scan is voluntarily uploaded, the video recording and associated camera data is retained on our servers in accordance with our data retention policies. For more information please see our Privacy Policy (https://nianticlabs.com/privacy).

Posted on
by

Last night the whole family got into a multiplayer Minecraft game for the first time in a while. Weirdly enough, *one* system was showing way too many materials as copper. Even stuff like snow. WTF?

Well, we realized it was after 7 PM local time, which meant on UTC time it was already April 1, so it must be this year’s April Fool’s joke for Minecraft. (Or in this case, one of the mods.) But why only on one computer?

Then it hit me: The host was a Windows machine, which means the hardware clock is set to local time (instead of being set to UTC and just displaying local time). I was connecting from a Linux box that dual-boots, so I’d long since set the hardware clock to local time so Windows wouldn’t fight with it. The one showing all copper, all the time, was a Mac, which doesn’t dual boot, and uses Unix under the hood, so its hardware was set to UTC, and it was the only computer of the three that was already running in April 1.

Posted on
by

I picked up Outer Wilds again now that the Echoes of the Eye expansion dropped, and finally finished the endgame. (No spoilers since the game is all about discovery. I’ll just say that it involved revisiting one of my least favorite mechanics in order to get to it, which is why I set it aside for so long).

The ending is a perfect, bittersweet coda to the story you uncover over the course of the game.

Space Wilderness

It’s a space exploration game that starts in a forest next to a campfire. The first thing you can do is toast a marshmallow. (You can do the same at campsites on all the planets.)

You explore the other planets in your tiny solar system using a ship made of plywood and sheet metal, with duct-tape repairs. The system is trapped in a time loop, and you need to figure out why, and what happened to the ancient aliens who visited the system eons ago and died out, leaving only ruins.

Each planet is wildly different – one’s a hollow shell around a small black hole, one’s an ocean world with constant storms, one’s a rocky world with a deep equatorial canyon that shares an orbit with a world covered in sand, one’s been shattered into pieces by a giant space-capable bramble. Events during the loop change the environments too, blocking some areas and revealing others.

Vs No Man’s Sky

In a sense, Outer Wilds is the opposite of No Man’s Sky.

  • One’s a tiny cluster of carefully-crafted worlds, each unique, each requiring different ways of exploring.
  • The other is an infinite galaxy of auto-generated worlds, but when it comes down to it, the differences are mostly in the aesthetics and labels. A high-radiation world and a high-temperature world don’t really differ except in which resource you use to recharge your shielding.

I mean, I like No Man’s Sky, I’ve got something like 180 hours on it since I finally picked it up this spring, but a lot of the game play is the same thing you’ve done before a zillion times, just dressed up differently and with better equipment or more inventory slots as you go along.

Campfire Songs

I’m listening to the soundtrack now. Most space games don’t use banjos and harmonicas as key instruments, but each astronaut in the game also plays music on a different instrument while sitting by their own campfire, each on a different planet. Though I’m not sure how the ocean one stays lit.

So here’s a toast(ed marshmallow) to the travellers from Timber Hearth.

Next goal: figuring out how to get to the new planet in the expansion!

Also posted on my reviews site

Posted on
by

I finally got around to trying out No Man’s Sky a few weeks ago. I started on a super-hot planet, where you need to find shelter and/or resources to recharge your suit’s hazard protection system to keep cool. Got killed a few times trying to figure out what I was doing. And after about 20 minutes, my computer spontaneously shut itself down.

I waited a few minutes to let it cool down, then tried again. Managed to figure out a bit more of what I needed to do in the game, and then the same thing happened.

Continue reading →

Posted on
by

I like Minecraft Earth, but it didn’t quite hit its stride before the pandemic, and didn’t adapt as well as Pokémon Go has to the pandemic. I’ve mostly stopped playing since hitting the level cap because gameplay is still too awkward, and while it is fun, it’s not enough fun to overcome that when I don’t have a goal to work toward.

So while I’m sad that it’s shutting down in June, it’s more “what could have been” than wishing I could keep playing it.

Live the Adventure!

Adventuring in augmented reality is the clear highlight of the game. You use your phone as a window into a life-size 3D fragment of a Minecraft world where you can fight zombies, mine resources, activate redstone contraptions, and so on. Initially these would spawn out in public spaces, and you could spot them from a distance like Pokémon Go gyms. During the pandemic, they changed to a system with “Adventure Crystals” that you can find or earn through challenges and activate to spawn an adventure at home. Different levels of crystals will spawn different sizes of adventures from simple up through “Epic.” Friends can scan a QR code on your phone to join you and you can play together in the same AR environment.

The main problems are:

  • You need enough space, especially for the bigger adventures.
  • You can’t choose the type of adventure, only the complexity. So you’re never sure if you’re going to get a puzzle, a battle, or just a lot of blocks to mine.
  • You can’t invite anyone to join you until the adventure starts, so if you have an epic adventure with 15 skeletons shooting at you and a half-dozen creepers ready to explode, you can’t take the time to get help.

Building

Build plates let you take a fragment (8×8, 16×16 or 32×32) of a Minecraft world, view it at tabletop scale in AR, and build what you want with it. You can use resources you’ve collected or crafted in other parts of the game. You can populate it with animals or monsters, or a “Mob of Me” that represents you. And you can play a life-size instance of it like an adventure, though again you need enough space for that.

Space is a problem here, too, and the process of actually building something complex in AR is awkward. Sometimes I think it would’ve been nice to be able to build in standard Minecraft UI, then play them in AR. And the real promise of this was being able to share your build plates with other players, which again was ruined by the pandemic.

I ended up mainly using build plates to farm. It’s cool that you can, though! Crops and trees grow, you can milk cows, shear sheep, etc. All on your dining table!

Collecting

That leaves the location part of the game: going out and collecting resources. That part is only really fun if you can get out and walk somewhere, which may or may not be possible depending on how locked-down your area is at any given time. But it’s less like catching Pokémon and more like spinning mobile Pokéstops. You’re just tapping on them as you get close to them, not jumping into a mini-game with actual strategy and skill to it. Once I’d collected enough resources to do all the building and crafting I wanted to, I stopped firing this mode up on walks because catching Pokémon was more interesting.

Challenges

They have at least tried to keep giving players new things to do by running biweekly challenge seasons. You collect or craft items, or solve adventure puzzles, or kill five zombies with a golden shovel (yeah, they get oddly specific after a while) in order to get a reward and unlock the next challenge. Even those get frustrating after a while, though. I keep getting stuck on defeating five skeletons (or whatever specific monster), and then for ten adventures in a row I’ll only find zombies, or spiders, or no mobs at all. Or chickens.

Sunset

At least Microsoft is handling it well. They announced it today, along with an update that includes all the remaining finished-but-unreleased content, discounts to in-game purchases, and nearly six months for us to play through the new features before shutting it down. (I’ve already found one of the new cow variants.) And aside from character items, which are already shared with Minecraft Bedrock Edition, they’re transferring currency over to Minecraft proper. So they’re giving the game a decent send-off and making an effort to keep players happy.

»All pages site-wide with this tag