Skip to content

Commit b67a9a7

Browse files
Fixed grammar in blog post
1 parent e1e115f commit b67a9a7

File tree

1 file changed

+12
-10
lines changed

1 file changed

+12
-10
lines changed

web/content/the-impact-of-ai-on-technical-interview-design.md renamed to web/content/the-impact-of-ai-on-the-technical-interview-process.md

Lines changed: 12 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -4,13 +4,13 @@ author: Charles Chen
44
description: AI's increasing competency at complex tasks like coding creates a boon for teams that want to harness AI to boost productivity. However, many teams haven't stopped to rethink their technical candidate screening and qualification process to account for these rapid changes.
55
---
66

7-
# The Impact of AI on Technical Interview Design
7+
# The Impact of AI on the Technical Interview Process
88

99
[{{ $doc.author }}]{.post-author} - [{{ $doc.date }}]{.post-date}
1010

1111
[{{ $doc.description }}]{.post-desc}
1212

13-
At the end of 2024, the startup I had joined was slowly winding down in an *acqui-hire*. As a part of this process, the entire engineering team would need to go through a round of technical interviews as a part of the leveling process.
13+
At the end of 2024, the startup I had joined was slowly winding down in an acqui-hire. As a part of this process, the entire engineering team would need to go through a round of technical interviews as a part of the leveling process.
1414

1515
To prepare for this, the team was told to prepare by studying leetcode and system design as these were known to be a part of the process for several of the potential acquiring companies.
1616

@@ -39,29 +39,29 @@ To distill it, you can probably think about it in 10 steps:
3939

4040
Watching the videos, it was pretty clear that this is the basic formula with only minor variations by domain. Why? Given the typical 60-90 minute session, how deep can you actually go with a topic as complex as system design? Not very. So the compromise is that the design remains at a high level and thus ***any backend API will pretty much look like bullets 4-10***.
4141

42-
While the coding challenges themselves are not nearly as scripted as the system design interview, if you spend enough time working on them you will get a sense for the general classes of solution patterns and I think that doing this correct classification is probably the most important step in most cases when working on leetcode challenges.
42+
While the coding challenges themselves are not nearly as scripted as the system design interview, if you spend enough time working on them you will get a sense for the general classes of solution patterns and I think that doing this correct classification step is probably the most important one in most cases when working on leetcode challenges.
4343

4444
Indeed, with a few weeks of practice, interviews with several large, public companies were a relative breeze (particularly system design!).
4545

4646
---
4747

48-
These processes seem to perpetuate in a vacuum as if ignoring how rapidly AI is changing the field of software engineering with advancements month-over-month if not seemingly weekly! While AI may not (yet) be the right tool to build whole systems, it is already quite competent in both autocompletion as well as generation of standalone units of code and can solve N-Queens hundreds of times faster than I could!
48+
These processes seem to perpetuate in a vacuum as if ignoring how rapidly AI is changing the field of software engineering with advancements month-over-month if not seemingly weekly! While AI may not *(yet)* be the right tool to build whole systems, it is already quite competent in both autocompletion as well as generation of standalone units of code and can solve N-Queens hundreds of times faster than I could!
4949

5050
> This last month is the first time that an LLM could "one shot" their second round assessment.
5151
5252
In a discussion with one of the senior hiring managers, the topic of AI came up and he shared some interesting perspective. Periodically, this manager takes their battery of assessments and runs them through an LLM to see how well it does at solving the first and second round questions and he shared that this last month is the first time that an LLM could "one shot" their second round assessment.
5353

5454
Given this reality, the question is: ***now what?***
5555

56-
Is the right answer to design a more complex set of assessments? *To what end?*
56+
Is the right answer to simply design a more complex set of assessments? To make it even more *Rube Goldberg*? *To what end?*
5757

58-
Throughout this whole process interviewing with a handful of companies, it was surprising that not once was a code review incorporated into the process. Yet code reviews are one of the most practical first-day and day-to-day skills -- **especially** for senior engineers.
58+
Throughout this whole process interviewing with a handful of companies, it was surprising that not once was a code review incorporated into the process. Yet code reviews are one of the most practical first-day and day-to-day skills -- **especially** for evaluating senior engineers.
5959

6060
Code reviews seem to have several benefits that address several challenges in the interview process.
6161

62-
For starters, code reviews naturally focus more on communication and collaboration rather than deep thought as is the case with coding challenges. Coding challenges are ironically a *terrible* vehicle for evaluating how well a candidate thinks via communication because it is so unnatural to talk while coding.
62+
For starters, code reviews naturally focus more on communication and collaboration more naturally than coding challenges which bias more towards deep focus. Coding challenges are ironically a *terrible* vehicle for evaluating how well a candidate thinks via communication because it is so unnatural to talk while coding.
6363

64-
Code reviews also have the benefit that it allows for more measuring both more depth and breadth. For example, a code review of a small React app, an API, and a database schema can easily identify a candidate's strength bias in the stack while still allowing measurement of the depth of their knowledge.
64+
Code reviews also have the benefit that it allows for measuring both more depth and breadth in one pass. For example, a code review of a small React app, an API, and a database schema can easily identify a candidate's strength bias in the stack while still allowing measurement of the depth of their knowledge.
6565

6666
- Incorporate some obvious bugs in the React app and some not so obvious ones.
6767
- Leave off some validation in the API or exclude exception handling entirely.
@@ -71,10 +71,12 @@ The variations are endless yet practical; a reflection of real day-to-day skills
7171

7272
Perhaps more importantly, as the field of software engineering inevitably shifts to increased and widespread adoption of AI powered tools in building software, it would seem that a key skill to actively screen for is proficiency in reading and evaluating code along the vectors of correctness, security, performance, best practices, and so on.
7373

74+
It is indeed true that the ability to read and evaluate code is not the same as the ability to write and organize code, but in this emerging age of AI generated code, *does this distinction carry the same weight*?
75+
7476
---
7577

76-
As AI continues to progress and advance, it seems inevitable that engineering teams will need to adjust their processes to with an understanding that the shift in how engineers build is already underway.
78+
As AI continues to progress and advance, it seems inevitable that engineering teams will need to adjust their technical screening processes with an understanding that the shift in how engineers build software is already well underway.
7779

78-
AI's increasing competency at coding means that rather than selecting purely for the ability to solve complex coding puzzles and algorithmic challenges, teams should consider how well the human shepherds are at evaluating the quality of that output.
80+
AI's increasing competency at coding means that rather than selecting purely for the ability to solve complex coding puzzles and algorithmic challenges, more teams should start to consider how well the human shepherds are at evaluating the quality of that voluminous output.
7981

8082
Rather than entirely shifting away from existing processes, teams should start to consider incorporating code reviews as a key step in the candidate selection process to identify those with a proficiency to effectively evaluating code.

0 commit comments

Comments
 (0)