{"id":41241,"date":"2024-10-24T07:17:26","date_gmt":"2024-10-24T14:17:26","guid":{"rendered":"https:\/\/coderpad.io\/?p=41241"},"modified":"2024-10-28T00:50:28","modified_gmt":"2024-10-28T07:50:28","slug":"genai-for-technical-hiring-friend-or-foe","status":"publish","type":"post","link":"https:\/\/coderpad.io\/blog\/hiring-developers\/genai-for-technical-hiring-friend-or-foe\/","title":{"rendered":"GenAI for Technical Hiring: Friend or Foe?"},"content":{"rendered":"\n<p>Your proverbial office watercooler might be awash with panic about candidates cheating on technical interviews using GenAI \u2013&nbsp;but is the pearl-clutching justified?&nbsp;<\/p>\n\n\n\n<p>Sure, the stakes are high. That\u2019s why there\u2019s so much handwringing.&nbsp;&nbsp;<\/p>\n\n\n\n<p>Hiring the wrong person. Not hiring the right person. Wasting time and money.\u00a0Wasting <em>engineers\u2019<\/em> time and money. Exacerbating recruiter-manager conflict. Declining slowly into irrelevance as the company struggles to hire the technical rockstars who power brilliant products and services\u2026<\/p>\n\n\n\n<p>But is GenAI genuinely such a threat? We don\u2019t think so.&nbsp;<\/p>\n\n\n\n<p>Actually, we think it\u2019s an opportunity. An opportunity to put your recruitment process under the microscope and build a more modern, more future-proof hiring function that\u2019s better placed to hire badass devs.\u00a0<\/p>\n\n\n\n<p>Let\u2019s talk about that.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>How prevalent is cheating really?&nbsp;<\/strong><\/h2>\n\n\n\n<p>One transformation expert <a href=\"https:\/\/www.businessinsider.com\/job-application-ai-chatgpt-how-to-explained-careers-cheating-hiring-2024-8\" target=\"_blank\" rel=\"noopener\">commented recently to Business Insider<\/a> that AI in recruitment is \u201can arms race that is just going to keep accelerating\u201d.&nbsp;<\/p>\n\n\n\n<p>It\u2019s an explosive image, with talent professionals on one side of the battlefield pitted against a new generation of wily jobseekers who want to win at any cost.<\/p>\n\n\n\n<p>But it\u2019s not necessarily a helpful image.<\/p>\n\n\n\n<p>Yes, AI is changing some of the ways we recruit. And it\u2019s changing some of the ways jobseekers seek jobs. But are candidates flocking en-masse to GenAI to pull the wool over interviewers\u2019 eyes?&nbsp;<\/p>\n\n\n\n<p>That\u2019s inherently a hard question to answer, because candidates who are really cheating are also unlikely to crow about it. But we think not.&nbsp;<\/p>\n\n\n\n<p>This combative image of HR versus candidates belies the truth, that most candidates genuinely want to find a job where they\u2019ll thrive. Most candidates don\u2019t want to start a job where they <em>can\u2019t, <\/em>any more than you want them to. Poor performance and eventual turnover aren\u2019t good for anyone.<\/p>\n\n\n\n<p><a href=\"https:\/\/coderpad.io\/blog\/interviewing\/qa-musings-of-a-ceo-on-tech-interviews-cheating-and-ai\/\">As our CEO Amanda Richardson puts it<\/a>:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>Trust that 99% of candidates believe in themselves enough to show their real skills, and the other 1% was always going to be undeterred.<\/p>\n<\/blockquote>\n\n\n\n<p>Ultimately, yes, GenAI offers new possibilities for cheating. But possibilities have always existed, for the 1% who\u2019re determined to cheat.<\/p>\n\n\n\n<p>For example:<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/d2h1bfu6zrdxog.cloudfront.net\/wp-content\/uploads\/2024\/10\/img_671a560140b19.png\" alt=\"A screenshot of a social media post\n\nDescription automatically generated\"\/><figcaption class=\"wp-element-caption\">(<a href=\"https:\/\/www.reddit.com\/r\/csMajors\/comments\/18dv9o7\/is_cheating_on_technical_interviews_common\/\" target=\"_blank\" rel=\"noopener\">Source<\/a>)<\/figcaption><\/figure>\n<\/div>\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/d2h1bfu6zrdxog.cloudfront.net\/wp-content\/uploads\/2024\/10\/img_671a56027f402.png\" alt=\"A white background with black text\n\nDescription automatically generated\"\/><figcaption class=\"wp-element-caption\">(<a href=\"https:\/\/www.reddit.com\/r\/webdev\/comments\/1acjvre\/has_ml_ai_killed_the_coding_interview\/\" target=\"_blank\" rel=\"noopener\">Source<\/a>)<\/figcaption><\/figure>\n<\/div>\n\n\n<p>The fact there are new possibilities doesn\u2019t mean cheating\u2019s becoming more prevalent. And we don\u2019t need to blow the problem out of proportion, in an echo-chamber of pearl-clutching.&nbsp;<\/p>\n\n\n\n<p>Recruiters need what you\u2019ve always needed. An awareness that cheating <em>can <\/em>happen; an understanding of the warning signs; and then rolled-up sleeves to get on with hiring-as-usual.&nbsp;<\/p>\n\n\n\n<p>There\u2019s another more pertinent question around the use of GenAI in technical interviews though, and that\u2019s this: <strong>is using GenAI actually cheating in the first place<\/strong>?&nbsp;<\/p>\n\n\n\n<p>That\u2019s a much more interesting question, because it pertains to the fundamentals of how you assess and hire the best people for the job.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Is using GenAI during technical interviews even cheating?&nbsp;<\/strong><\/h2>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>Say you\u2019re interviewing for a job as a baker. It\u2019s reasonable that the interviewer might ask you to bake some bread, right?&nbsp;<\/p>\n\n\n\n<p>But then imagine they refuse to let you use rising agents, even though rising agents are standard practice, because they want to see how you bake bread without artificial support.<\/p>\n\n\n\n<p>It\u2019s lose, lose. From their side, they aren\u2019t actually assessing you on the skills you\u2019ll use daily. Maybe you\u2019re an excellent baker using rising agents but without, won\u2019t do yourself justice. So they miss out on an excellent hire.<\/p>\n\n\n\n<p>And from your side, how long before you abandon hiring processes like that entirely? It\u2019s borderline offensive. You\u2019re a serious baker, you want to work somewhere that values your skills; somewhere that doesn\u2019t place arbitrary restrictions during recruitment just because a tiny minority of lesser bakers might take advantage.\u00a0<\/p>\n\n\n\n<p>That\u2019s exactly the risk with GenAI.<\/p>\n<\/blockquote>\n\n\n\n<p>AI is fundamentally changing how developers work, and that\u2019s a great thing. McKinsey research last year found that developers can complete coding tasks up to twice as fast with generative AI, for example:<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/d2h1bfu6zrdxog.cloudfront.net\/wp-content\/uploads\/2024\/10\/img_671a560290608.png\" alt=\"A graph of blue and white bars\n\nDescription automatically generated\"\/><figcaption class=\"wp-element-caption\">(<a href=\"https:\/\/www.mckinsey.com\/capabilities\/mckinsey-digital\/our-insights\/unleashing-developer-productivity-with-generative-ai\" target=\"_blank\" rel=\"noopener\">Source<\/a>)<\/figcaption><\/figure>\n<\/div>\n\n\n<p>Likewise, our <a href=\"https:\/\/coderpad.io\/survey-reports\/coderpad-and-codingame-state-of-tech-hiring-2024\/\">State of Tech Hiring 2024<\/a> report found that 70% of developers think AI will help reduce their workload, and 60% would like to use more AI at work.<\/p>\n\n\n\n<p>Of course, meeting rooms are alight with concerns about AI. Business likes certainty, not change, and anything that potentially impacts productivity is high stakes.\u00a0\u00a0<\/p>\n\n\n\n<p>But the direction of travel is towards embracing AI. Ultimately that\u2019ll mean your developers increasingly using these tools day-to-day\u2013so eventually, you\u2019ll need to be hiring for those skills, just as you would any other job requirement.\u00a0<\/p>\n\n\n\n<p>Moreover, even if GenAI isn\u2019t yet a priority for your organization, this has an impact <em>today<\/em> \u2013 because recruitment\u2019s fundamentally future-looking.&nbsp;&nbsp;<\/p>\n\n\n\n<p>That is: let\u2019s presume you\u2019re hiring with a view to developers staying, say, three-plus years. That means you need to hire people now with an eye on tomorrow. Building a future-ready workforce means understanding how skills needs could evolve and building them into the organization proactively.&nbsp;<\/p>\n\n\n\n<p>Which brings us back to baking. It just doesn\u2019t make much sense, blocking candidates at interviews from using tools that they either <em>already<\/em> or almost certainly <em>will<\/em> use on the job.\u00a0<\/p>\n\n\n\n<p>Plus, there\u2019s a strong argument to say <a href=\"https:\/\/coderpad.io\/blog\/hiring-developers\/hiring-managers-you-should-want-candidates-to-use-chatgpt-to-pass-your-technical-interviews-heres-why\/\">GenAI is an incredible acceleration opportunity for diversity<\/a>, democratizing skills that have traditionally been guarded and gatekept. Improving inclusiveness and widening the talent pool are major priorities for approximately <em>everyone.&nbsp;<\/em><\/p>\n\n\n\n<p>GenAI: friend. Right? But then we come full circle.<\/p>\n\n\n\n<p>Because if you authorize GenAI for technical interviews, what about the candidates who will take the opportunity to cheat? And how can you build an accurate understanding of candidates\u2019 abilities, if they\u2019ve used AI?<\/p>\n\n\n\n<p>Even if it\u2019s only 1%, you still need to protect against the risk of hiring the wrong people. Or missing out on the right people, because you chose someone ahead of them who used GenAI to puff out their feathers.&nbsp;<\/p>\n\n\n\n<p>We know this stuff is a big concern. But luckily, we\u2019re not advocating the wild, wild west. You can accommodate GenAI in a sensible, measured way that safeguards your process and protects the organization.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>How to have your cake and eat it: <em>mitigated<\/em> GenAI&nbsp;<\/strong><\/h2>\n\n\n\n<p>How can you harness GenAI in the recruitment process but also protect against cheating? There\u2019s a simple answer and a longer, more nuanced answer.<\/p>\n\n\n\n<p>The simple answer is to choose <a href=\"http:\/\/www.coderpad.io\" data-type=\"link\" data-id=\"www.coderpad.io\">assessment and interview tools<\/a> that allow candidates to use GenAI \u2013 but also have built-in functionality to discourage, detect and respond to suspicious activity.\u00a0<\/p>\n\n\n\n<p>For instance, CoderPad has a heap of <a href=\"https:\/\/coderpad.io\/blog\/hiring-developers\/18-features-your-tech-assessment-tool-should-have-to-prevent-cheating\/\">features to help mitigate cheating<\/a> and prompt areas for further discussion, to help you get under the skin of a candidate\u2019s approach. Like:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Code playback<\/strong> to see how candidates wrote their code<\/li>\n\n\n\n<li><strong>IDE exit detection<\/strong> to know if\/when candidates left their test<\/li>\n\n\n\n<li><strong>Copy\/paste tracking<\/strong> to spot if code might\u2019ve originated elsewhere<\/li>\n\n\n\n<li><strong>Plagiarism detection<\/strong> to spot if exact code is reused<\/li>\n\n\n\n<li><strong>Location tracking<\/strong> to check candidates are where they say they are<\/li>\n\n\n\n<li><strong>Anomaly alerts<\/strong> for unusual candidate activity or performance&nbsp;<\/li>\n\n\n\n<li><strong>Candidate flagging<\/strong> to spot where you might need to investigate more<\/li>\n\n\n\n<li><strong>Webcam proctoring<\/strong> and AI analysis to flag suspicious behavior&nbsp;<\/li>\n\n\n\n<li><strong>Question randomization<\/strong> to mitigate the risk of question sharing<\/li>\n\n\n\n<li><strong>Question timers<\/strong> to prevent searching for answers<\/li>\n\n\n\n<li><strong>Test performance tracking<\/strong> to detect unusual improvement trajectories<\/li>\n\n\n\n<li><strong>AI follow-up questions<\/strong> to check candidates\u2019 understanding of code<\/li>\n<\/ul>\n\n\n\n<p>The problem of cheating on technical tests might be overblown, but it\u2019s one that available tooling is well-equipped to tackle if support is needed. Note the \u2018if\u2019, though. \u2018Anti-cheating\u2019 functionality is a tool in your toolbox\u2013but not everything\u2019s a nail that needs a hammer.\u00a0<\/p>\n\n\n\n<p>That\u2019s the simple answer. But there\u2019s a but, because the real answer is much more nuanced. Of course.<\/p>\n\n\n\n<p>If you want to avoid getting into the \u201carms race\u201d we spoke about earlier\u2013that endless and combative race to the bottom\u2013it\u2019s less about monitoring cheating and more about building <a href=\"https:\/\/coderpad.io\/events\/why-and-how-technical-realism-will-solve-your-it-recruitment-problems\/\" data-type=\"event\" data-id=\"40130\">realistic, engaging hiring and assessment processes<\/a> that empower candidates\u2019 true skills to shine.\u00a0<\/p>\n\n\n\n<p>So there\u2019s less incentive to cheat, and both sides of the table can make an informed decision about job fit.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Prioritizing the candidate experience with&nbsp;a realistic, engaging recruitment process<\/strong><\/h2>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/d2h1bfu6zrdxog.cloudfront.net\/wp-content\/uploads\/2024\/10\/img_671a5603133fd.png\" alt=\"A screenshot of a computer\n\nDescription automatically generated\"\/><figcaption class=\"wp-element-caption\">(<a href=\"https:\/\/www.reddit.com\/r\/learnprogramming\/comments\/12g1961\/do_all_companies_ask_dumb_leetcode_questions_in\/\" target=\"_blank\" rel=\"noopener\">Source<\/a>)<\/figcaption><\/figure>\n<\/div>\n\n\n<p>Last year, 37.5% of organizations told Infragistics they\u2019re <a href=\"https:\/\/devops.com\/addressing-the-developer-skills-gap\/\" target=\"_blank\" rel=\"noopener\">struggling to find skilled developers<\/a>. Good devs are in high demand.&nbsp;<\/p>\n\n\n\n<p>That means your best candidates are probably in-process with plenty of other companies. How much patience would <em>you <\/em>have for answering the same set of by-rote questions again and again before you turned to Google or AI?&nbsp;<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>The fact is, if your process relies on copy\/paste questions, you\u2019re leaving the door open for copy\/paste answers.<\/p>\n<\/blockquote>\n\n\n\n<p><a href=\"https:\/\/interviewing.io\/blog\/how-hard-is-it-to-cheat-with-chatgpt-in-technical-interviews\" target=\"_blank\" rel=\"noopener\">A recent experiment from Interview.io<\/a> found that verbatim LeetCode-style questions had a 38% higher pass rate using ChatGPT than the control group not using ChatGPT, for example (53% compared to 73%).&nbsp;<\/p>\n\n\n\n<p>And worse, you\u2019re probably driving away good people who aren\u2019t willing to \u201cwaste time\u201d on \u201cuseless arbitrary puzzle questions\u201d. (Not good anyway; extra not-good given <a href=\"https:\/\/hatchworks.com\/blog\/gen-ai\/software-engineer-shortage\/\" target=\"_blank\" rel=\"noopener\">the severe developer shortage<\/a>).&nbsp;<\/p>\n\n\n\n<p>If you don\u2019t treat candidates with respect, it\u2019s not all that surprising if they don\u2019t respect your process.<\/p>\n\n\n\n<p>A better way is to deliver realistic, natural, custom-to-you assessments and interviews that actually relate to the real-world job. In an engaging format that\u2019s worth candidate\u2019s time (while ideally demanding less internal time to manage, especially from your engineers).&nbsp;<\/p>\n\n\n\n<p><a href=\"https:\/\/coderpad.io\/blog\/hiring-developers\/chatgpt-and-the-future-of-technical-interviews-addressing-concerns-of-increased-cheating\/\">Let candidates use GenAI<\/a>, if that\u2019s how they work best. But within a platform that flags when and how they\u2019re using it, so you can discuss with curiosity rather than condemnation.&nbsp;<\/p>\n\n\n\n<p>A recruitment process like that is much more valuable for everyone \u2013 giving candidates a better sense of whether the job\u2019s for them and giving you a better sense of whether the candidate\u2019s right for the job.&nbsp;<\/p>\n\n\n\n<p>And it\u2019s miles more cheat-proof, too. Coming back to Interview.io\u2019s experiment, customized questions had a dramatically lower pass rate using ChatGPT, of only 25%.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Fear-based or opportunity-orientated: what\u2019s your hiring philosophy?&nbsp;<\/strong><\/h2>\n\n\n\n<p>Lots of organizations that hire technical talent are settling for lackluster, generic processes \u2013 and then wondering why they struggle to hire or have high cheat rates.&nbsp;<\/p>\n\n\n\n<p>That\u2019s not good enough anymore. Not if you hope to compete for top technical talent in an increasingly competitive environment where the bar for recruitment processes is continuously being raised.&nbsp;<\/p>\n\n\n\n<p>Choosing to integrate GenAI into your technical hiring process is really a question of your recruitment philosophy.&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Do you see candidates as an enemy to crack down on; ready to pounce on any loophole and cheat?&nbsp;<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Or do you recognize that you\u2019re all on the same side, trying to honestly assess whether a career move is right?\u00a0<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Do you settle for a generic, boring, repetitive recruitment process that insults candidates\u2019 intelligence and integrity?&nbsp;<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Or do you care about delivering a candidate experience that\u2019s considerate, respectful, and engaging, as well as pragmatic?<\/li>\n<\/ul>\n\n\n\n<p>We know which side will wind-up with the strongest dev teams. And from there, the best processes, products and services, and the happiest customers and strongest bottom lines.&nbsp;<\/p>\n\n\n\n<p>That\u2019s a recipe for high-value technical recruitment teams who are taken seriously.&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Is GenAI genuinely a threat? We don\u2019t think so.\u00a0Actually, we think it\u2019s an opportunity. An opportunity to put your recruitment processes under the microscope and build a more modern, more future-proof hiring function.<\/p>\n","protected":false},"author":18,"featured_media":41274,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[23],"tags":[],"persona":[28],"blog-programming-language":[],"keyword-cluster":[],"class_list":["post-41241","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-hiring-developers"],"acf":[],"_links":{"self":[{"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/posts\/41241","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/comments?post=41241"}],"version-history":[{"count":5,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/posts\/41241\/revisions"}],"predecessor-version":[{"id":41255,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/posts\/41241\/revisions\/41255"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/media\/41274"}],"wp:attachment":[{"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/media?parent=41241"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/categories?post=41241"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/tags?post=41241"},{"taxonomy":"persona","embeddable":true,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/persona?post=41241"},{"taxonomy":"blog-programming-language","embeddable":true,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/blog-programming-language?post=41241"},{"taxonomy":"keyword-cluster","embeddable":true,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/keyword-cluster?post=41241"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}