On intuition and resilience | PhD
One of my {worst, best} personality traits is that whenever someone tells me something is hard or impossible, I have an immediate, almost uncontrollable urge to do that exact thing. That is how I’ve made some of my past choices about college, classes, extracurriculars, projects, and research, which is probably not always a good thing or productive use of time. However, one of my colleagues asked me about how one would encourage this mindset, since he wants his daughter to become more comfortable with being challenged.
So I thought about it, and part of it is probably just me being stubborn and wanting to be contrarian. But I think a large part of the impulse is also because of an experience I had in undergrad. It was pretty terrible at the time and sort of broke me, but it did end up completely shifting my perspective on intuition and how far hard work can actually take you.
I consider the lowest point of my academic career to be the semester I took my first operating systems class. My undergrad required all CS majors to take this class, and it was infamous for having brutally difficult and time-consuming projects. That semester lived up to its reputation: my group and I would spend 20-30 hours in the lab each week struggling to finish these projects (on top of lectures, other classes, research, etc.).
The reason I say this experience broke me is because I felt broken: computer science stopped making sense to me, and I no longer wanted to do it anymore. For the first time, I would sit down in front of a problem and have absolutely no idea on how to proceed. That internal sense of direction that used to always know how to navigate a problem had vanished. Devising solutions and coding up answers in that class no longer felt right or satisfying the way they used to.
Part of me did question if this meant I didn’t have what it took to be in computer science. I remember a particularly demoralizing debugging session where I took a break outside and stared vacantly at the 3am sky, wondering if I should switch majors. In the end, I brute-forced my way through the class by working as hard as I could, ultimately performing very well. But even though I was able to derive all of the correct solutions, it was never through that intuitive sense of clarity that had guided me through all of my other classes.
However, I later became a TA for that class. And one day, as I was reviewing one of the project specifications ahead of office hours, I realized that the old feeling I had missed was there: all of the possible solutions to the project just made sense. They were so clear, so obvious—how had I ever been confused by this?
This realization completely changed the way I view intuition and resilience. It’s not like this was the first time I learned the value of hard work or had ever struggled in a class. For instance, I did not have a good time with high school physics, and though I similarly managed to perform well by working very hard, I absolutely hated the experience and never wanted to take a physics class again.
But I think the difference between operating systems and physics was how far my hard work ultimately took me before I stopped: in both cases, I performed well in the class by the end of the semester, but it did not feel natural or easy the way other topics did. It felt like even if I could reach competence through hard work, there was some innate barrier of me being “bad” at physics or systems that prevented me from having true intuition for these problems.
It was only after really absorbing the operating systems material as a TA that my perspective changed. It was empowering that a problem that had once seemed so impossible, so inscrutable, was now elementary and trivial to me. I finally understood that intuition in a domain was not something I either had or didn’t have, but rather something that would inevitably be built. Just as importantly, this experience made me comfortable with that feeling of being broken, of struggling to understand exactly what I was doing, so that I would not give up before things finally clicked.
I later took real analysis in undergrad, intrigued because I had heard so many horror stories about it being some sort of hazing/rite of passage for math majors. Maybe I should have listened—it ended up being the only class I’ve ever had an actual nightmare about, and the only class where I would lie fully awake in bed each night before an exam, unable to sleep from anxiety. But a lot of what got me through that semester was reminding myself that I had once overcome the seemingly impossible in operating systems, so surely I could do it again. I am still not sure if that semester was necessary or worth it, but in the end, I emerged a much better mathematician.
Though I do not use much direct knowledge from my operating systems or real analysis classes in my research, those experiences have certainly shaped how I go through my PhD. A large part of it is being comfortable with sometimes feeling confused and lost when I work on projects, especially those on initially unfamiliar topics. The other aspect of this is that I am far too eager to jump into hard projects, which may not always turn out to be a good thing.
When one of my advisors was suggesting project topics, he first suggested genome assembly. It was a problem I had always found somewhat interesting, but then my advisor went on to describe it as the hardest problem in our field, saying that this would be the most challenging option by far. That was enough to make me immediately want to work on it—I listened to my advisor’s other suggestions and thought about them as well, but I already knew deep down that I would be picking assembly. Other researchers in my field have similarly described it as an absolute behemoth of a problem to tackle, which only made me more excited to get started.
And, well, who could’ve guessed? They were right; it’s hard. Every step is twenty times more complicated than I had initially expected. Sometimes I open my computer and stare at my deformed assembly graphs and wonder why I was so stubbornly attached to the idea of trying this. I wonder if perhaps I was being too naïve—what if I finally hit the wall? What if I finally flung myself at a problem I can’t overcome?
Since this project is still ongoing, I can’t say whether I will emerge victorious from this project the way I have in the past. Sometimes it really feels like I won’t. But then I think about how much more I know compared to even just a month ago, and how those initial stages of the project already make so much more sense. And I think about those once-impossible operating systems projects, and those once-impossible real analysis proofs, and I think I can maybe emerge okay.
January 21, 2025