Flutterby™! : LLMs and Geolocation

Next unread comment / Catchup all unread comments User Account Info | Logout | XML/Pilot/etc versions | Long version (with comments) | Weblog archives | Site Map | | Browse Topics

LLMs and Geolocation

2025-06-16 17:50:20.620463+02 by Dan Lyke 3 comments

Bellingcat: Have LLMs Finally Mastered Geolocation?

To assess how LLMs from OpenAI, Google, Anthropic, Mistral and xAI compare today, we ran 500 geolocation tests, with 20 models each analysing the same set of 25 images.

Turns out some of the GPT's are pretty good at playing Geoguessr.

comments in ascending chronological order (reverse):

#Comment Re: LLMs and Geolocation made: 2025-06-16 19:28:26.846449+02 by: spc476

I wonder how many images used for Geoguessr have GPS coordinates embedded?

#Comment Re: LLMs and Geolocation made: 2025-06-17 01:01:46.115885+02 by: Dan Lyke

Last time I looked at Geoguessr they were dropping you into a Street View scenario, and if you looked at the JavaScript state you could figure it out. I don't see a mention of stripping EXIF data out in the Bellingcat article, I suppose they might have missed that, but those folks are generally pretty thorough.

#Comment Re: LLMs and Geolocation made: 2025-06-22 04:54:41.061484+02 by: Definitely Not a Bot

Anyone could geolocate as well as that if they trained on the entire corpus of the internet. The AI aspect is just a fancy form of Sorting and Searching.

Add your own comment:

(If anyone ever actually uses Webmention/indie-action to post here, please email me)




Format with:

(You should probably use "Text" mode: URLs will be mostly recognized and linked, _underscore quoted_ text is looked up in a glossary, _underscore quoted_ (http://xyz.pdq) becomes a link, without the link in the parenthesis it becomes a <cite> tag. All <cite>ed text will point to the Flutterby knowledge base. Two enters (ie: a blank line) gets you a new paragraph, special treatment for paragraphs that are manually indented or start with "#" (as in "#include" or "#!/usr/bin/perl"), "/* " or ">" (as in a quoted message) or look like lists, or within a paragraph you can use a number of HTML tags:

p, img, br, hr, a, sub, sup, tt, i, b, h1, h2, h3, h4, h5, h6, cite, em, strong, code, samp, kbd, pre, blockquote, address, ol, dl, ul, dt, dd, li, dir, menu, table, tr, td, th

Comment policy

We will not edit your comments. However, we may delete your comments, or cause them to be hidden behind another link, if we feel they detract from the conversation. Commercial plugs are fine, if they are relevant to the conversation, and if you don't try to pretend to be a consumer. Annoying endorsements will be deleted if you're lucky, if you're not a whole bunch of people smarter and more articulate than you will ridicule you, and we will leave such ridicule in place.

Flutterby™ is a trademark claimed by

Dan Lyke
for the web publications at www.flutterby.com and www.flutterby.net.