Personal profile
Biography
Julian Singh is a PhD student in the ANU School of Computing. He returns to ANU after more than 20 years working across government, consulting and technology in Canberra, Melbourne, London and New York.
Research
LLM chatbots are increasingly used for personal and morally consequential advice, but it remains unclear what meaningful evaluation should measure.
- How should these systems be evaluated in extended personal conversations?
- How can symbol grounding, semiotics and related frameworks inform practical evaluation criteria?
- Where do existing benchmarks provide adequate evidence, and where are the gaps?
His research aims to develop a reproducible method for deriving evaluation criteria and auditing existing benchmarks.
Professional background
- Founded the open-data startup OpenDataConnect.
- Nine years’ volunteer service with Wikimedia.
- Board roles with GovHack Australia and the Australian Institute of Professional Photography.
- ANU graduate in information technology and commerce; MBA from Melbourne Business School.