Short answer: use AI to test you on chemistry, not to solve it for you. Studies of chatbots on real general chemistry exams found they recognised the concept in a question well but got multi-step problems wrong far more often than students, and their wrong answers sounded convincing. So give the AI your own notes, ask it for questions one at a time, work every calculation yourself, and check anything numerical against your notes, textbook or specification.
How good is AI at chemistry?
Better at words than at working. In 2023, Ted Clark gave ChatGPT the questions from final exams in two general chemistry courses. On the closed-response questions it was, in his words, very capable at identifying the concept, even when the question was full of chemical symbols. But its success at actually solving problems was only 44%, well below the class average of 69%. On open questions it did better when the topic needed general knowledge and worse when it needed specific skills taught in lectures.
The most important line in that paper is about the mistakes: incorrect responses and flawed explanations were often logically sound and would be persuasive to a novice. That is the real risk for a student. A wrong answer that looks wrong is harmless. A wrong answer that reads like a textbook gets learned.
A second 2023 study, by Leon and Vidhani in the same journal, tested ChatGPT on chemistry questions in both multiple-choice and free-response formats. Neither format scored higher than 37%, and the authors note that even when it can pick the right answer in context, it may not be able to tell whether that answer is correct computationally.
These studies used 2023 versions of ChatGPT, and newer models are stronger. But the pattern they describe, fluent explanations with shaky calculations, is still the right thing to guard against, because you usually cannot tell from the tone of an answer whether it is right.
What AI is useful for in chemistry revision
Chemistry revision is roughly three jobs: knowing the facts and definitions, understanding why things happen, and doing calculations and mechanisms under time pressure. AI helps unevenly with each.
- Facts and definitions: useful, if it quizzes you. Definitions of terms like electronegativity, the observations for a test for ions, the conditions for a reaction. These are exactly what retrieval practice is good for. In Roediger and Karpicke's (2006) experiments, students who tested themselves remembered much more a week later than students who reread, even though rereading made them feel more confident.
- Understanding: useful, if you explain first. Ask it to check your explanation of why a trend happens rather than to give you one. Your attempt shows you what you actually understand.
- Calculations and mechanisms: risky. Moles, equilibrium, energetics, pH and mechanisms are where the studies above found the most errors. Use AI to set the problem and to react to your working, not to produce the working.
Leaning on it for answers has a cost beyond accuracy. In a field experiment with nearly a thousand high-school maths students, Bastani and colleagues (2025) found that students who practised with an unrestricted GPT-4 assistant did 17% worse once it was taken away than students who never had it. A version designed to give hints rather than answers largely avoided that harm. Chemistry calculations work the same way: the skill is in doing them.
A chemistry revision session with AI, step by step
- Start from your own material. Paste in or upload your class notes, the relevant textbook section or your specification point. Exam boards differ in what they expect, and a chatbot left to itself defaults to whatever is most common online. Tell it your level and board.
- Ask for one question at a time. Mix recall ("state the test for sulfate ions and the result") with calculation ("calculate the mass of product from 4.0 g of reactant").
- Answer on paper first. Write the full working, with units and significant figures, before you type anything back.
- Mark against your notes, not just the chat. For calculations, redo the AI's arithmetic yourself if it disagrees with you. Either of you could be wrong.
- Keep a list of misses. Return to them in a day or two. Our spaced repetition schedule gives sensible gaps.
For more on chemistry revision without AI, including how to approach organic chemistry, see how to study chemistry.
Prompts that make it test you
- "I'm revising [topic] for [GCSE/A level/first-year university] chemistry with [exam board]. Using only the notes below, ask me one question at a time and wait for my answer."
- "Set me a two-step moles calculation like the one in these notes. Don't show the answer until I've posted my working."
- "Here is my working. Don't redo it. Tell me which line, if any, contains the first mistake."
- "Give me a multiple-choice question on this definition where the wrong options are mistakes a student who half-learned it would make."
- "Quote the line from my notes that supports your answer."
The last prompt is the most useful habit. If it cannot point to your notes, treat the answer as unchecked. Our guide to checking AI study answers has more on this.
Chemistry traps to watch for
- Arithmetic and rounding. Check every number, especially unit conversions (cm³ to dm³, kJ to J) and significant figures.
- Formulae and charges. A missing subscript or a wrong charge on an ion changes the whole answer. Compare with your data sheet.
- Syllabus drift. It may explain an idea at a level your course does not use, or use a model your teacher told you not to use in the exam.
- Diagrams. Text chatbots are weakest with structures, apparatus and mechanisms drawn as images. Practise these from your own diagrams.
This is also why some students use a tool that writes questions only from their file. Ace turns your chemistry notes, slides or textbook PDF into practice questions written only from that material, checks every answer against it and shows the sentence from your file that backs it. For formula topics it can give you an interactive simulation where you set the value, and it can label diagrams using screenshots from your own file. You still do the calculations; it makes sure the question and the answer come from what you were taught.
Frequently asked questions
Is ChatGPT good at chemistry?
It is good at recognising concepts and explaining them in words, and less reliable at multi-step calculations. Studies on 2023 versions found it scored well below students on problem-solving. Newer models do better, but you should still check every number.
Can I use AI to check my chemistry calculations?
Yes, as a second opinion. Ask it to find the first wrong line in your working rather than to give its own answer, and if you disagree, redo the step yourself with your data sheet.
Should I ask AI to make chemistry flashcards?
It can, from your notes. Check each card against your material, and keep calculation practice separate: flashcards are for facts and definitions, while calculations need full worked problems.
Is using AI for chemistry revision cheating?
Using it to quiz yourself is not. Submitting its work as yours in coursework or homework can be. Follow your school or university's rules.
Sources
- Clark, T. M. (2023). Investigating the use of an artificial intelligence chatbot with general chemistry exam questions. Journal of Chemical Education, 100(5), 1905–1916. doi.org/10.1021/acs.jchemed.3c00027
- Leon, A. J., & Vidhani, D. (2023). ChatGPT needs a chemistry tutor too. Journal of Chemical Education, 100(10), 3859–3865. doi.org/10.1021/acs.jchemed.3c00288
- Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2025). Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences, 122(26), e2422633122. doi.org/10.1073/pnas.2422633122
- Roediger, H. L., & Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249–255. doi.org/10.1111/j.1467-9280.2006.01693.x



