Seeing is believing in biomedicine, which isn't great when AI gets it wrong

HELLFIRE

https://www.theregister.com/2025/07/27/biomedviz_ai_wrong_problems/
https://arxiv.org/abs/2507.14494

Biomedical visualization specialists haven’t come to terms with how or whether to use generative AI tools when creating images for health and science applications. But there’s an urgent need to develop guidelines and best practices because incorrect illustrations of anatomy and related subject matter could cause harm in clinical settings or as online misinformation; … either way, imagery created by generative AI may look nice but isn’t necessarily accurate, the authors say. …

Regards

px_eliezer_

Some AI systems are downright wacked.

DuckDuckGo has a few different trial AI methods on their site now.

When using one of them (NOT their main choice), I was looking for other doctors in my specialty in my geographic area—just to see if I was listed, and to keep track of competitors.

The AI result created fake addresses, fake doctor names, and while one of the phone numbers was real, it was for a nearby Mexican restaurant.

broknsymetry

px_eliezer_ one of the phone numbers was real, it was for a nearby Mexican restaurant.

Could have been for a gastroenterologist.

telcodad

px_eliezer_ … fake doctor names, and while one of the phone numbers was real, it was for a nearby Mexican restaurant.

Was it for a “Dr. Enchilada?” 🙂

It just amazes me how AI can make up fake stuff like this.

See: https://en.wikipedia.org/wiki/Hallucination_(artificial_intelligence)

egeezer

px_eliezer_ The AI result created fake addresses, fake doctor names, and while one of the phone numbers was real, …

Doctor Demento and Doctor Johnny Fever come highly recommended.