{"id":3617,"date":"2023-03-16T11:49:12","date_gmt":"2023-03-16T06:19:12","guid":{"rendered":"https:\/\/careeradvice.in\/mbbs-abroad\/?p=3617"},"modified":"2023-03-16T11:49:16","modified_gmt":"2023-03-16T06:19:16","slug":"chatgpt-takes-neet-will-it-pass-or-fail","status":"publish","type":"post","link":"https:\/\/careeradvice.in\/mbbs-abroad\/blog\/chatgpt-takes-neet-will-it-pass-or-fail\/","title":{"rendered":"ChatGPT Takes NEET; Will it Pass or Fail?"},"content":{"rendered":"\n

We tested ChatGPT on all the questions from NEET 2022, and the results are baffling<\/p>\n\n\n\n

Microsoft-backed OpenAI\u2019s\u00a0ChatGPT\u00a0is known for its versatility for the chatbot can switch between generating complex codes to composing songs with ease. Its capabilities extend beyond the literary and technical realms, as it now has an array of impressive academic accomplishments to show off.<\/p>\n\n\n\n

Besides acing the MBA program at the University of Pennsylvania and the law exam at Minnesota Law School, the chatbot passed the\u00a0United States Medical Licensing Examination (USMLE)\u00a0at one go, which usually takes aspiring doctors close to four years and over two years of clinical rotations to clear.\u00a0<\/p>\n\n\n\n

But, after a failed\u00a0attempt at UPSC,\u00a0AIM<\/strong>\u00a0decided to check ChatGPT\u2019s medicine prowess. This time around, we experimented with\u00a0NEET<\/a>\u00a0(UG), one of the most difficult entrance examinations for medical aspirants, which often requires more than one attempt to get into the top medical schools in India. A record 18 lakh students appeared for the exam in 2022.<\/p>\n\n\n\n

Also Read |\u00a0NEET UG 2023 Registrations Started \u2013 Apply Now<\/a><\/strong><\/p>\n\n\n\n

Did ChatGPT Pass or Fail? <\/h3>\n\n\n\n

We grilled\u00a0ChatGPT\u00a0on all 200 questions from the NEET 2022 paper available online. It consists of 180 multiple-choice questions (MCQs) from Physics, Chemistry, and Biology (Botany and Zoology) subjects. NEET also has 20 extra questions called \u2018bonus\/trial questions\u2019 that do not carry any marks but are included to assess the candidates\u2019 knowledge and understanding of the subject. So, we tested ChatGPT on all 200 questions.\u00a0<\/p>\n\n\n\n

Every right answer would fetch our examinee four marks, while every wrong answer would cost it one negative mark. We skipped 10 questions from Physics, 15 from Chemistry and 1 from Biology as they were based on graphs and diagrams.<\/p>\n\n\n\n

Although ChatGPT is trained on data only up to 2021, no question in the paper was based on current affairs.<\/p>\n\n\n\n

Extremely Weak in Botany<\/h3>\n\n\n\n

ChatGPT is a weak student when it comes to Biology, especially Botany. It answered almost half of the questions in Biology incorrectly, most of which were from Botany.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

As seen in the screen grab above, above. The chatbot could not answer the question. The answer, according to the internet and the solution paper, is maize. However, if you tweak the\u00a0prompt, it can give the right answer.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

So, it was clear that a lot of the game depends on prompts. When we altered the prompts in the second attempt, the chatbot could answer many questions correctly. Everytime it gave a wrong answer, it had its own analysis which it readily rectified, when prompted.<\/p>\n\n\n\n

MBBS Abroad Admissions |\u00a0Click Here To Get MBBS Admissions Abroad At Very Low Fees<\/a><\/strong><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

This takes us back to the fact that LLMs are prone to hallucinations. Google Bard, Microsoft Bing, and Meta\u2019s Galactica, have all given incorrect responses leading to major setbacks.<\/p>\n\n\n\n

ChatGPT is an Average Kid<\/h3>\n\n\n\n

ChatGPT relies on probabilistic distribution since LLMs are naturally non-deterministic (next token predictors) and not \u201cunderstanders\u201d. In conversation with Debarghya Das<\/strong><\/a>, founding engineer at Glean<\/a>, on LLM and hallucination, he told AIM<\/strong> that LLMs struggle with basic Math involving large numbers because they are focused on predicting the next token, rather than computing the answer. <\/p>\n\n\n\n

\u201cLLMs may not always provide accurate information as they rely on probability distributions and may be influenced by examples of incorrect information. Retrieval-augmented generation techniques can be used to solve this problem, where the model generates answers based on information from reliable web sources,\u201d he added. <\/p>\n\n\n\n

Unlike chatbots, it is much more difficult for humans. ChatGPT is trained on a staggering 175B parameter, unlike the human brain. We spoke to several medical students to understand why it takes more than a year to crack NEET. Imagine taking a test where your success rate depends not on your intelligence or critical thinking, but on your ability to memorise facts, especially in Biology. That\u2019s the reality which aspiring medical students are facing in India to pass the NEET.<\/p>\n\n\n\n

Annjali Sarkar<\/strong>, a third-year medical student at the prestigious RG Kar Medical College and Hospital<\/a>, Kolkata, said, \u201cAdding to the peril is the stress that comes with answering 180 questions manually in 180 minutes allotting 1 minute for each. The answering scheme makes it irreversible to make changes. So, no matter how ChatGPT passes medical, it surely can\u2019t compete with the real struggles that we face.\u201d <\/p>\n\n\n\n

Meta AI chief\u00a0Yann Lecun\u00a0notes that\u00a0ChatGPT\u00a0could be \u201cuseful and fun\u201d but it can\u2019t compete with human intelligence and is nothing more than a writing aid at most. Even OpenAI head Sam Altman acknowledged that the chatbot is incredibly limited, and should not be relied on for factual queries. But OpenAI is constantly working towards making it better.<\/p>\n\n\n\n

So, what if ChatGPT can\u2019t be a\u00a0public servant\u00a0in India, it can be an average doctor, for sure.<\/p>\n\n\n\n

(Source: analyticsindiamag.com)<\/p>\n\n\n\n

Read all the latest news articles\u00a0HERE<\/a>.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

We tested ChatGPT on all the questions from NEET 2022, and the results are baffling Microsoft-backed OpenAI\u2019s\u00a0ChatGPT\u00a0is known for its versatility for the chatbot can switch between generating complex codes to composing songs with ease. Its capabilities extend beyond the literary and technical realms, as it now has an array of impressive academic accomplishments to […]<\/p>\n","protected":false},"author":1,"featured_media":3622,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[11],"tags":[],"_links":{"self":[{"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/posts\/3617"}],"collection":[{"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/comments?post=3617"}],"version-history":[{"count":1,"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/posts\/3617\/revisions"}],"predecessor-version":[{"id":3623,"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/posts\/3617\/revisions\/3623"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/media\/3622"}],"wp:attachment":[{"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/media?parent=3617"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/categories?post=3617"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/careeradvice.in\/mbbs-abroad\/wp-json\/wp\/v2\/tags?post=3617"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}