1-2 of 2
Anna C. Doris
Close
Save search
Follow your search
Access your saved searches in your account
Would you like to receive an alert when new items match your search?
Close Modal
Sort by
Journal Articles

DesignQA: A Multimodal Benchmark for Evaluating Large Language Models’ Understanding of Engineering Documentation

Anna C. Doris, Daniele Grandi, Ryan Tomich, Md Ferdous Alam, Mohammadmehdi Ataei, Hyunmin Cheong, Faez Ahmed
Journal: Journal of Computing and Information Science in Engineering
Publisher: ASME
Article Type: Research Papers
J. Comput. Inf. Sci. Eng. February 2025, 25(2): 021009.
Paper No: JCISE-24-1230
https://doi.org/10.1115/1.4067333
Published Online: December 23, 2024
View Article titled, DesignQA: A Multimodal Benchmark for Evaluating Large Language Models’ Understanding of Engineering Documentation
Open the PDF for DesignQA: A Multimodal Benchmark for Evaluating Large Language Models’ Understanding of Engineering Documentation in another window
Topics: Computer-aided design, Design, Dimensions, Engineering design, Large language models, Retrieval-augmented generation, Vehicles, Engineers, Engineering drawings, Engineering drawing and drafting
Proceedings Papers

DesignQA: Benchmarking Multimodal Large Language Models on Questions Grounded in Engineering Documentation

Anna C. Doris, Daniele Grandi, Ryan Tomich, Md Ferdous Alam, Hyunmin Cheong, Faez Ahmed
Proc. ASME. IDETC-CIE2024, Volume 3A: 50th Design Automation Conference (DAC), V03AT03A016, August 25–28, 2024
Publisher: American Society of Mechanical Engineers
Paper No: DETC2024-139024
https://doi.org/10.1115/DETC2024-139024
View Paper titled, DesignQA: Benchmarking Multimodal Large Language Models on Questions Grounded in Engineering Documentation
Open the PDF for DesignQA: Benchmarking Multimodal Large Language Models on Questions Grounded in Engineering Documentation in another window
Topics: Large language models, Design, Computer-aided design, Engineering design processes, Engineering drawings, Engineers, Student competitions