Reshape Automation Index Shows General AI Recommending the Wrong Industrial Parts

A customer asks their distributor whether a Siemens communication module, part number 3RW5950-0CH00, works with a 3RW52 soft starter, and the distributor turns to AI to find out. Claude, with web search turned on, said yes all three times it was asked.

The verified answer is no.

The module belongs with the 3RW55 series, and an order placed on that answer ships a part that doesn't fit the equipment for which it was bought.

That question is one of 100 in the Industrial AI Accuracy Index 2026, published by Reshape Automation, covering 14 manufacturer catalogs including Siemens, Festo, Rittal and ATI Industrial Automation.

What the models got wrong

Most of it: With web search, GPT-6 Astra scored 52% and Claude 40.5%. Without it, all three models landed between 12% and 14%. Even the best setup got 42 of the 100 questions wrong, with partial answers earning half credit.

Wrong with confidence: About 1 in 3 wrong answers gave a specific code or figure with no caveat. Asked when a Festo actuator was discontinued, one model gave a different part number and date on each of three tries, and none was correct.

Different answers to the same question: Each question went to five model setups, three times each, and in 66 of those 500 pairings the runs didn't agree. Asked for a Rittal KX terminal box in 304 stainless, 200 by 200 by 80, Gemini gave a specific SKU, then said no such box exists in that range, then gave a different SKU.

Worst on configured parts: Where a part number is built from the manufacturer's ordering rules instead of printed in a catalog, as with ATI's robot tool changers, GPT-6 Astra with web search scored 22.7% and Claude scored 0%. On ordinary part lookups, web search had raised scores by 51 points for GPT-6 Astra and 35 for Claude.

Why the models get parts questions wrong

"The AI products on the market today are mostly a general-purpose model with search or a document store bolted on, and they're very good at a lot of work," said Juan Aparicio, CEO and co-founder of Reshape Automation. "Parts questions are different. The answer is usually a relationship between three or four facts that live in different places, like a catalog, a datasheet or a cross-reference table, and some of it was never written down at all. If the model has to rebuild that relationship every time someone asks, it'll sometimes get it right and sometimes not, and it'll sound equally sure both times."

"Distributors are where these questions land," Aparicio said. "A customer asks whether a part fits, someone on the inside sales team has a few minutes to answer, and one wrong digit ships the wrong part. A tool that's right half the time doesn't save that person any work, because they still have to check every answer."

What ReshapeX does differently

ReshapeX is Reshape Automation's family of AI agents for the technical and commercial work behind industrial sales and support: customer service, application engineering, inside sales and field maintenance. The agents select and size products, build valid part numbers from specs, find replacements and accessories, and cross-reference and price a bill of materials hundreds of lines long. They quote RFQs, answer "where's my order?," walk a technician through a fix, and show a sales rep what an account bought, stopped buying and could buy next.

They work inside the ERP and CRM and wherever customers and staff already are: website chat, Outlook, Microsoft Teams, WhatsApp and voice. Reshape customers report 60% to 90% time savings in technical support, customer service and inside sales, and an 18.6% increase in average order value.

The agents leverage leading AI models, such as GPT and Claude, and Reshape builds the harness around the model: the knowledge it answers from, the tools it can call, and the checks an answer passes before a customer sees it.

That knowledge is assembled once, before anyone asks. For each manufacturer, Reshape pulls the catalog, datasheets, cross-reference data and the rules the brand's engineers know into one knowledge graph that stores the relationships: what fits what, how a configured part number is built, what replaced a discontinued part. Every fact carries its source, and engineers review the graph before any agent uses it. The agents still search the web or check live stock when that's the right source. Ask the same question twice and you get the same answer.

Want more information? Click below.

Reshape Automation

Rate this article

[Reshape Automation Index Shows General AI Recommending the Wrong Industrial Parts]

Very interesting, with information I can use
Interesting, with information I may use
Interesting, but not applicable to my operation
Not interesting or inaccurate

E-mail Address (required):

Comments:


Type the number:



 

Copyright © 2026 by Nelson Publishing, Inc. All rights reserved. Reproduction Prohibited.
View our terms of use and privacy policy ::m::