The rise of AI coding tutors has created a paradox for educators, who must now determine how to assess real skills in an environment where AI tools are increasingly used in software development. A survey of 700 computer science educators from 49 countries, conducted by an ACM task force, found that 69 percent believe AI has changed the skills needed for software development. This shift has forced educators to reevaluate traditional teaching and assessment methods, moving away from rote coding exercises toward more practical, problem-solving focused approaches.

The survey revealed that 64 percent of educators have already shifted their teaching methods away from writing code from scratch toward code comprehension, debugging, and problem-solving. This change reflects a broader recognition that AI tools will play a significant role in the workforce, and students must be prepared to work with these tools effectively. As a result, educators are increasingly emphasizing skills that complement AI, such as critical thinking and collaboration.

The survey also found that 68 percent of respondents have adjusted how they test students, with a growing emphasis on proctored in-person exams, oral exams, code defense sessions, and project-based assessments. These changes aim to ensure that students are not just using AI tools but also understanding the underlying principles of software development. The shift is particularly evident in higher education, where institutions are grappling with how to balance the use of AI in teaching with the need to develop fundamental coding skills.

The consequences of these changes are far-reaching, affecting both the cost and structure of education. Institutions may need to invest in new assessment tools and training for educators, which could increase expenses. Additionally, the reliance on AI tools may lead to concerns about vendor lock-in, as institutions become dependent on specific platforms for teaching and assessment. Governance issues also arise, as educators and institutions must navigate the ethical implications of using AI in education and ensure that assessments remain fair and transparent.

As the use of AI in education continues to evolve, the debate over how to assess real skills will likely intensify. While some argue that AI can enhance learning by providing personalized feedback and support, others caution that overreliance on AI may undermine the development of fundamental skills. The challenge for educators is to find a balance that leverages the benefits of AI while ensuring that students are equipped with the knowledge and abilities needed to succeed in a rapidly changing technological landscape.