Treffer: Comparing Code Generation Capabilities of ChatGPT-4o and DeepSeek V3 in Solving TypeScript Programming Problems

Title:
Comparing Code Generation Capabilities of ChatGPT-4o and DeepSeek V3 in Solving TypeScript Programming Problems
Source:
Proceedings of the International Conference on Information Systems Development (ISD)
Publisher Information:
AIS Electronic Library (AISeL)
Publication Year:
2025
Collection:
Association for Information Systems Research: AIS Electronic Library (AISeL)
Document Type:
Fachzeitschrift text
File Description:
application/pdf
Language:
unknown
DOI:
10.62036/ISD.2025.21
Accession Number:
edsbas.15109F35
Database:
BASE

Weitere Informationen

The rapid development of large language models significantly impacts software development, particularly in code generation. This paper focuses on the analysis of the performance and features of ChatGPT and DeepSeek chatbots, based on their GPT-4o and V3 models, respectively, with an emphasis on code generation. Particular attention is given to the architecture of the models, multimodality, open-source status, and token limits. Through experimental evaluation of 60 TypeScript LeetCode problems across different difficulty levels, we evaluated accuracy, debugging ability, and the number of attempts needed for correct solutions. The results show that DeepSeek achieved an accuracy of 68.3%, while ChatGPT achieved 61.7%. The paper highlights the advantages of DeepSeek as an open-source option and points to the potential to improve generated code, contributing to the understanding of the application of large language models in programming.