John K Pate Macquarie University Department of Computing Building E6A Sydney, NSW 2109 Phone: (+61) (0) 414 796 255 Email: john.pate@mq.edu.au Homepage: http://jkpate.net Research Interests I am interested in how children induce linguistic structure from data. There are two parts to this ques- tion: what assumptions about grammatical form do children implicitly make (i.e., what are their learning biases), and what is the evidence they rely on? I use structured probabilistic models to quantify how well, and in what ways, different kinds of evidence disambiguate various grammatical forms. In previous and current work, I have looked at how acoustic cues, such as word duration, might provide useful evidence for identifying syntactic structure. I plan to start using such models to evaluate how well different as- sumptions about morphosyntactic abstraction match child language comprehension and production. I am also interested in expanding my research program to include laboratory experiments that follow up on computational results. Employment Macquarie University . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2013 – present Post-doctoral research fellow in Machine Learning and Computational Linguistics. Education The University of Edinburgh Ph.D, Informatics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2013 Supervisor: Sharon Goldwater Thesis title: “Predictability effects in language acquisition” The Ohio State University M.A., Linguistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2009 B.A., Linguistics, with Honors, with Research Distinction, Magna Cum Laude . . . . . . . . . . . . . . . . . 2009 Honors & Awards Scottish Overseas Research Students Awards Scheme . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2009–2013 Scottish Informatics and Computer Science Alliance Prize Studentship . . . . . . . . . . . . . . . . . . . . .2009–2013 Phi Beta Kappa . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2008 Undergraduate Research Office Summer Research Fellowship . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2008 National Merit Scholarship . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2005–2009 The Ohio State University Distinguished Scholarship . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2005–2009 John K Pate 2 Research Assistantships Laura Wagner’s Developmental Language & Cognition Lab, Ohio State . . . . . . . . . . . . . . . . . . 2007–2009 Helped design and execute a study on the development of dialect perception in children. Administered experiments. Carried out laboratory maintenance tasks, including recruitment of parents and subject scheduling. Cynthia Clopper’s Speech Perception Lab, Ohio State . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2007–2009 Implemented experiments in E-Prime. Recruited subjects. Administered experiments. Performed initial results processing and analysis. Annotated speech data. Software All of these software packages can be freely accessed from my website under Free and Open Source Software licenses. All the Scala code is parallelized across cores. PredictabilityParsing, an implementation of the Dependency Model with Valence in Scala, including: Expectation-Maximization for Maximum-Likelihood estimates. Both the original O(n5) formulation and the O(n3) formulation using the “Fold-Unfold” transform. Mean-field Variational Bayes for Bayesian estimates. Interpolated backoff to learn from two observations per time step. ProsodicParsing, an implementation of Hidden Markov Model-based unsupervised syntactic chunkers in Scala. Provides standard HMMs, HMMs with two observations per time step, and Coupled HMMs. Based on a modified version of GRaphical Models in Mallet (GRMM). modelselect.R, a model selection algorithm in R, written with Moreno Coco, for finding a mixed effects model that is both tractable and well-controlled. ShakesEM, an implementation of the Inside-Outside algorithm for binary branching PCFGs. Contains an implementation of Inside-Outside for unlabeled but partially bracketed training data. Miscellaneous bug fixes and feature enhancements to GRMM, Fluxbox, vim-latex-box, and other FOSS projects. Programming Languages Proficient with several programming languages, including Scala, Java, Perl, R, Python, and Bash. John K Pate 3 Teaching TA for Computational Cognitive Science . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .Autumn 2010, 2011, 2012 Helped create assignments, problem sheets, and exams. Led 2-3 recitation sections each term. Delivered 1-2 guest lectures each term. Marked half of the assignments each term. Manuscripts in Preparation Pate, J K & Goldwater, S (In Prep). Bootstrapping syntactic dependencies from effects of predictability and prosodic phrasing on word duration. Pate, J K & Goldwater, S (In Prep). Talkers modulate predictability effects according to channel and listener characteristics: Evidence for audience design. Wagner, L, Clopper, C & Pate, J K (Under Revision). Children’s perception of dialect variation. Journal of Child Language. Publications Pate, J K & Goldwater, S (2013). Unsupervised dependency parsing with acoustic cues. Transactions of the Association for Computational Linguistics 1. pp 63–74. Pate, J K & Goldwater, S (2011). Predictability effects in adult-directed and infant-directed speech: Does the listener matter? In Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, Boston, Massachusetts. Pate, J K & Goldwater, S (2011). Unsupervised syntactic chunking with acoustic cues: Computational models for prosodic bootstrapping. In Proceedings of the 2nd Workshop on Cognitive Modeling and Com- putational Linguistics, Portland, Oregon. [Received best student paper award]. Clopper, C & Pate, J K (2009). Effects of talker and token variability on perceptual learning of dialect categories. In Proceedings of Meetings on Acoustics. Pate, J K & Meurers, W D (2007). Refining Syntactic Categories Using Local Contexts – Experiments in Unlexicalized PCFG Parsing. In Proceedings of the Sixth International Workshop on Treebanks and Linguistic Theories. Bergen, Norway. Last updated: May 21, 2013