Post

"We're all worried," as what it means to do research (in my field, Theoretical CS) seems to be shifting, and shifting fast. What to do? Senior researchers must lead by example, knowing that not everything will pan out. What I'm suggesting below may not work everywhere, but here's my own advice: 1/

52 reposts206 likes

I don't know about research but for development don't just ask for the thing propose the solution and explore it with the agent. Use the "grill me" skill or just ask it to propose several alternatives and explore the traid offs.

If you are junior you can also ask the agent to fill in the boiler plate and leave the important parts in blank so you have to fill them in. Or he can write the tests and you write the code, or the other way around, do this often and you learn so much more than being stuck on a syntax error...

Use it as a mentor, a senior with infinite patience but ask it to challenge you, ask also questions about the implementation or a design decision... In other words: do the thinking without being stuck in google searches, errors you don't understand or ugly traces.

Yeah, it’s simple: avoid AI completely, and actually do your job. And to seniors: if you’re worth anything as a mentor, tell them to avoid AI and to actually do their job. Furthermore, evaluate AI-based “research” as much as it’s worth (which, to be clear, is not zero but *negative* worth).

I also think there is interesting work to be done on the human/AI work flows and interactions. In particular, ability of AI to spit out what road blocks still remain, which ones are solved and where, and which ones it will work on. Also more info from AI on where it fails and why

🧵To seniors: - move away from bean-counting (easy, right?). E.g., when evaluating CVs or grants or applicants, ask for the top 3 pubs, with a paragraph explaining why these are important. Hiring on a CV of 50 pubs was always sort of meaningless, now it's become meaningless-er (!) and gameable. 2/

The difficulty will be that the world university rankings still largely rely on bean-counting. In a sane world those rankings would be irrelevant, but while lack of Govt funding leaves Australian (and UK) Unis so reliant on intl students, those rankings will still heavily influence Uni strategy.

- stop the public hand-wringing and doomerism. Things are worrying and scary, yes, but this is (y)our job to navigate it (you/we have the stability and, allegedly, the experience). We can afford to think about it and try things out! If we project despair publicly, then how is that going to go? 3/

- be there for the junior researchers, and be generous with your funding/opportunities. Again, You (we? I feel old) have more stability, more of a cushion. Go out of your way to ease the path of the next generation and shield them. 4/ (end of personal, biased advice for senior TCS researchers)

If I may Shield them from palace intrigue and unimportant turmoil. Don't Shield them from the new difficulties of the present research funding environment. Walk through it with them. Shielding younger professionals from long term trends doesn't help them learn how to deal with it when you are gone

🧵To juniors: - Move away from LPUs, at all costs. (Nobody likes to think of their own paper as LPU: what I mean here is "a paper just good enough to be published in a fairly good conf even a year ago") These publications are most likely going to die, or not being valued any more, as flood-prone 2/

What does LPU stand for here? 'Lowest publishable unit' or something like that? In physics I heard of this referred to as a 'publon'; one quanta of publishable material.

- go for exposition. Write, write well (if necessary, learn how to). Papers are meant to disseminate knowledge to others. Reading your work, things should "click": this is important, this is novel, this is the key takeaway. We'll no longer be competing on pages of derivations, that "flex" is gone 3/

LOL. I mean twchnically I can't say about CS, but in mathematics, even most humans write very poorly, and the practice of writing like sht is encouraged in top level journals. AIs copy papers and have no teaching experience, so no chance there.

(Technical skills will still be necessary of course, just no longer sufficient) - aim for the hard or interesting stuff (especially conceptual). Now is the time to go for the long, blue-sky-ish projects. Learn new areas, go deep. The times of competing on superficial breadth are gone (sorry, me) 4/

- Relatedly, go for something you are deeply passionate or curious about: if the next couple years are going to be (possibly) a struggle, at least don't let it be about things you don't really like or care about! 5/ (end of personal, biased advice for junior TCS researchers)

Senior researchers have been grasping the prolific increase in LPU with both hands, driven by university hunger for rankings/metrics. As an ECR I think your best shot long-term is to focus on good science, as you say, even if you're disadvantaged in the short term. History will judge you kindly IMO.