Category: events

2016 review

Research. Theme #1: Decision making: Most of the work I’ve done this year hasn’t yet seen the light of day. Our Michael J Fox Foundation funded project using typing as a measure of the strength of habitual behaviour in Parkinson’s Disease continues, and we’ll finish the data analysis next month. Likewise, we should also soon finish the analysis on our project ‘Neuroimaging as a marker of Attention Deficit Hyperactivity Disorder (ADHD)’. Angelo successfully passed his viva (thesis title: “Decision modelling insights in cognition and adaptive decision making”) and takes up a fellowship at Peking University in 2017 (well done Angelo!).

This thread of work, which is concerned with the neural and mechanistic basis of decision making, informs the ‘higher-level’ work I do on decision making, which is preoccupied with bias in decision making and how to address it. This work, done with Jules Holroyd and Robin Scaife, has focussed on the idea of ‘implicit bias‘, and what might be done about it. As well as running experiments and doing conceptual analysis, we’ve been developing an intervention on cognitive and implicit bias, which summarises the current state of research and gives some practical advice on avoiding bias in decision making. I’ve done a number of these sessions with judges, which has been a humbling experience: to merely study decision making and then be confronted with a room of professionals who dedicate their time to actually making fair decisions. As with the other projects, much more on this work will hopefully see the light in 2017.

World events have made studying decision making to understand better decisions seem more and more relevant. Here’s a re-analysis of some older data which I completed following the UK’s referendum on leaving the EU in June: Why don’t we trust the experts? (and, relatedly, my thoughts on being a European scholar). Also on this topic, a piece for The ConversationHow to check if you’re in a news echo chamber – and what to do about it.

Journal publications on decision making:

Holroyd, J., Scaife, R., Stafford, T. (in press). Responsibility for Implicit Bias. Philosophy Compass.
Pirrone, A., Azab, H., Hayden, B.Y., Stafford, T. and Marshall, J.A.R. (in press). Evidence for the speed-value trade-off: human and monkey decision making is magnitude sensitive. Decision
Panagiotidi, M., Overton, P.G., Stafford, T. (in press). Attention Deficit Hyperactivity Disorder-like traits and distractibility in the visual periphery. Perception.
Pirrone, A., Dickinson, A., Gomez, R., Stafford, T. and Milne, E. (in press). Understanding perceptual judgement in autism spectrum disorder using the drift diffusion model. Neuropsychology.
Bednark J., Reynolds J., Stafford T., Redgrave P. and Franz E. (2016). Action experience and action discovery in medicated individuals with Parkinson’s disease. Frontiers in Human Neuroscience, 10, 427. DOI 10.3389/fnhum.2016.00427.
Lu, Y., Stafford, T., & Fox, C. (2016). Maximum saliency bias in binocular fusion. Connection Science, 28(3),258-269.

(catch up on all publications on my scholarly publications page)

 

Research. Theme #2: Skill and learning

My argument is that games provide a unique data set where participants engage in profound skill acquisition AND the complete history of their skill development is easily recorded. To this end, I’ve several projects analysing data from games. This new paper : Stafford, T. & Haasnoot, E. (in press). Testing sleep consolidation in skill learning: a field study using an online game. Topics in Cognitive Science. (data + code) is an example of the new kinds of analysis – as well as the new results – which large data from games allow. The paper is an advance on our first work on this data (Stafford & Dewar, 2014), and is a featured project at the Centre for Data on the Mind. I gave a talk about this work at a workshop ‘Innovations in online learning environments: intrapersonal perspectives‘, for which there is video (view here: Factors influencing optimal skill learning: data from a simple online game).

I have been analysing a large dataset of chess games (11 million + games) and presented initial work on this at the Cognitive Science Conference. You can read the paper or see the code, results and commentary in an integrated Jupyter notebook (these are the future). There’s lots more exciting stuff to come out of this data!

Our overview of how the science of skill acquisition can inform development of sensory protheses came out: Bertram, C., & Stafford, T. (2016). Improving training for sensory augmentation using the science of expertise. Neuroscience & Biobehavioral Reviews, 68, 234-244 (Talk slides, lay summary).

Also: I wrote for The Conversation about an important review of the literature on the benefits of Brain Training, and I had a great summer student looking at the expertise acquired by Candy Crush players.

 

Teaching & thinking about teaching: Not as much to report as last year, since I had teaching leave for the autumn semester, as part of our Leverhulme project on bias and blame. At the beginning of the year I taught a graduate discussion class on dual-process theories in psychology and neuroscience, which was very worthwhile, but didn’t leave much digital trace. Whilst I’ve not been teaching classes, I have been thinking about teaching, publishing this in The Guardian: The way you’re revising may let you down in exams – and here’s why (my third piece in the G on learning), this on NPJ ‘Science of Learning’ Community: Do students know what’s good for them? (I’m proud of this one, mainly for the quality of the outgoing links it includes), and this, for The Conversation, on a under-noted consequence of testing in education: Good tests make children fail – here’s why.

I also used some informal platforms (i.e. blogging etc) to produce some guidance for psychology students: This on what I call the Hierarchy of critique, and this on the logic of student experiment reports, and I tried to provoke some discussion around this : I don’t read students’ drafts. Should I?

I did some talks for graduate students (follow the links for slides): Adventures in research blogging and Expanding your writing portfolio.

 

Peer reviewing: I feel this should be recorded somewhere, since peer reviewing is a part of an academic’s job which requires the pinnacle of their expertise and experience, yet is generally unrecognised and unrewarded. This year I helped the scholarly community out by doing grant reviews for the Medical Research Council and the Biotechnology and Biological Sciences Research Council and manuscript reviews for Trends in Cognitive Sciences, Memory and Cognition, Connection Science, Canadian Journal of Philosophy, Journal of European Psychology Students, International Journal of Communication and the Annual Cognitive Science Society conference. From 1st of January I will only be reviewing papers which make their data freely available, as part of the Peer Reviewers’ Openness Initiative.

 

That’s mostly it, bar a few things I couldn’t fit under these four headlines. Thanks to everyone who helped with the work in 2016 – getting to talk, write and pursue ideas with sincere, intelligent, kind and interesting people is the best part of the job.

(Previously: 2015 review)

Written by Comments Off on 2016 review Posted in events

internship: Public Engagement Coordinator

If you are a recent graduate of the University of Sheffield, then you can apply for this paid internship as Public Engagement Coordinator, working with me in the Department of Psychology. Here’s a bit about what we want to do:

Help the Department of Psychology engage with the public. Our vision is to arrange, promote, run and record a series of
“TED”-style talks for Psychology at Sheffield. These will be our chance to reach hundreds of college age students – both those in our majority recruitment demographic and those from under-represented backgrounds.

And here’s a bit about who we’re looking for:

The ideal candidate will be enthusiastic for what Universities can offer society, and vice versa. You will have an appreciation of the concerns of applicants to the University – especially those from “widening participation” backgrounds – and be capable of keeping track of a complex set of tasks. In this internship you will learn to organise and promote large events, to put scholarship in a wider context and see how issues in people’s everyday lives connect to the work we do in the Department of Psychology. You will practice writing in an engaging and accessible way and get to work with people across the University and the region.

It’s six months, full time, paid. Here are links for the overview and job description, but to apply you need to go to careerconnect.sheffield.ac.uk and enter reference UOS014640. To be eligible you need to have graduated from a University of Sheffield undergraduate degree in 2016. Closing date: 4th of November 2016

Any questions, feel free to get in touch with me

Written by Comments Off on internship: Public Engagement Coordinator Posted in events

CogSci @ Sheffield

This mailing list: CogSci at Sheffield supports the ad hoc network of researchers at the University of Sheffield who are interested in Cognitive Science. You can sign yourself up and receive notifications about events happening across the University (but mostly emanating from Psychology, Philosophy, Linguistics and Computer Science).

Written by Comments Off on CogSci @ Sheffield Posted in events

We are European Scholars

I am British, but consider myself a European scholar. At the start of my time as a lecturer at the University I was lucky enough to be part of an EU funded project on learning in robots. With that project I worked with brilliant colleagues around the EU, as well as being able to do the piece of work I regard as my single most important scientific contribution. It was EU projects like this which inspired the foundation of Sheffield Robotics, a collaboration between the two Universities in Sheffield which aims to define the future of a technology vital to manufacturing in the UK. Two British PhD students I supervised during this project went on to start a business, and a third – from Cyprus – did work with me that led to a major grant from the Michael J Fox Foundation for research into Parkinson’s Disease – bringing US funding into the UK to allow me to work with colleagues in Spain and the US on a health issue that will affect 1 in 500 of us: over 120,000 people in the UK.

Since then I have had two more brilliant PhD students from the EU. One, from Greece, completed a PhD on differences in sensory processing in ADHD and has since gone to work in industry, applying her research skills for a company based in Manchester. The other, an Italian, is currently writing up, and considering job opportunities from around the world. My hope is that we’ll be able to keep him in the UK, where he’ll be able to continue to contribute to the research environment that make British Universities the best in the world.

The UK needs Universities to train our young people, to contribute to public life and to investigate the world around us and within us. And the UK’s Universities need Europe.

I am a European scholar. We are European Scholars at the University of Sheffield. Without our European links and colleagues we, and the UK, would be immeasurably impoverished.

Written in support of yesterday’s call by the University of Sheffield’s Vice-Chancellor

Written by Comments Off on We are European Scholars Posted in events

Dangers and advantages in the idea of implicit bias

Last night I was on a panel discussion around the theme of “Success: is it all in the mind? A discussion on women in science.”

On that panel we discussed the idea of implicit bias, that we can behave in ways that are prejudiced even if we believe ourselves to be without prejudice (or even, anti-prejudice). Relevant examples might be: in meetings interrupting women more than men, filling departmental seminar or conference keynote slots with men rather than women, rating CVs which come from women as less employable and deserving less salary and so on.

The idea of implicit bias has both benefits and dangers for how we talk about bias. On the positive side, it gives us a mechanism for thinking about discrimination which isn’t about straightforward explicit prejudice. Sure, there are people who think “Women can’t do physics” or “Women shouldn’t work”, but implicit bias lets us talk about more subtle prejudice, it helps make visible the intangible feeling that, in a thousand different ways, life is different for members of different social groups. Relatedly, implicit bias lets us recognise that the line of division cuts through every one of us. It isn’t a matter of dividing the world into the sexists vs the feminists, say. Rather, because we’re all brought up in a world which discriminates against women we acquire certain gender-prejudiced habits of thought. Even if that only means automatically of a man when asked to imagine a scientist, then that can have accumulating effects for women in science. Finally, thinking about implicit bias gives a handle on what it might mean for an institution or a culture to be prejudiced. Again, without the need to identify individuals, implicit bias can help us talk about the ways in which we participate, or our organisation participates, in perpetuating discrimination. Nobody has to want people who are more likely to have childcare commitments to be excluded, but if your departmental meetings are always at 4pm then you are risking excluding them.

But the idea of implicit bias can have a negative influence as well. We live in an age which is fascinated by the individual and the psychological. Just because implicit biases can be measured in individuals’ behaviour doesn’t mean that all problems of discrimination should be addressed at the psychological level of individuals. If one thing is clear about implicit bias it is that the best approaches to addressing it won’t be psychological. This is a collective project, there is little or no evidence that ‘retraining’ individual’s implicit biases works, and raising awareness, whilst important, doesn’t provide a simple cure. Approaching bias at an institutional or inter-personal level is more likely to be effective – things like tracking the outcomes of hiring decisions or anonymised marking have been shown to be effective for mitigating bias or insulating individuals from the possibility of bias.

Secondly, the way people talk about bias evokes a metaphor of our rational versus irrational selves which owes more to religion than it does to science. Implicit biases are often described as unconscious biases, when the meaning of unconscious is unclear, and there’s plenty of evidence that people are aware, in some ways, of their biases and/or able to intervene in their expression. By describing bias as ‘unconscious’ we risk thinking of these biases as essentially mysterious -unknowable and unalterable (and from there the natural thought is, well there’s nothing I can do about them). My argument is that biases are not some unconscious, extraneous, process polluting our thinking. Rather, they are constitutive of our thinking – you can’t think without assumptions and shortcuts. And assumptions and shortcuts, while essential, also create systematic distortions in the conclusions you come to.

The idea of implicit bias helps us see prejudice in unexpected places – including our own behaviour. It sets our expectations that there will be no magic bullet for addressing bias, and progress will probably be slow, because cultural change is slow. These are the good things about thinking about the psychology of bias, but although the psychological mechanisms of bias are fascinating, we must recognise the limitations of only thinking about individuals and individual psychology when trying to deal with prejudice, especially when that prejudice is embedded in far wider historical, social and economic injustices. Nor should we allow the rhetoric of biases being ‘unconscious’ trick us into thinking that bias is unknowable or unaccountable for. There is no single thing to be done about discrimination, but things can be done.

Links & Endnotes:

The event was “Success: is it all in the mind? A discussion on women in science.”, organised by Cavendish Inspiring Women the other panelists were the Jessica Wade , Athene Donald and Michelle Ryan. My thanks to all the organisers and our chair, Stuart Higgins.

My thinking about bias is funded by the Leverhulme Trust, on a project led by Jules Holroyd. All my thinking about this has benefited from extensive discussion with her, and with the other members of that project (Robin Scaife, Andreas Bunge).

A previous post of mine about bias mitigation, which arose from doing training on bias with employment tribunal judges

A great book review: What Works: Gender Equality by Design, by Iris Bohnet, which says many sensible things but which risks describing bias as unconscious and therefore more mysterious and intractable than it really is

A good example of the risk of ‘psychologising’ bias: there are more police killings of blacks than whites in the US, but that may reflect other injustices in society rather than straightforward racist biases in police decisions to shoot (and even if it did, it isn’t clear that the solutions would be to target individual officers). See also ‘Implicit Bias Training for Police May Help, but It’s Not Enough‘.

A great discussion of the Williams and Ceci (2015) claim that “sexism in science is over”, and also here . See also ‘How have gender stereotypes changed in the last 30 years?’.

Written by Comments Off on Dangers and advantages in the idea of implicit bias Posted in events

2015 review

Here’s a selective round-up of my academic year

Teaching: I taught my Cognitive Psychology course for the second time. It takes inspiration from MOOCs and ‘flipped classroom’ models, so I try and scaffold the lectures with a bunch of online resources and pre- and post- lecture activities. This year I added pre-lecture quizes and personalised feedback for each student on their engagement. Based on thinking about my lecture discussions I wrote a short post on Medium ‘Cheap tricks for starting discussions in lectures‘ (the truth is, lectures are bad place for starting discussions, but sometimes that’s what you have to work with). I rewrote my first year course on emergent models of mind and brain. It uses interactive jupyter notebooks, which I’m very happy with. The lectures themselves show off a simple neural network as an associative model of memory, and the interactive notebooks mean that students can train the neural network on their own photos if they want. I also held an ‘intergenerational tea party’ every Thursday afternoon of autumn semester where I invited two students I supervise from every year of the undergraduate course (and my PG students and post-docs). If you came to one of these, thanks – I’ll be doing it again next semester.

Writing: I had a piece in the Guardian The science of learning: five classic studies,  as well as my regular BBC Future column, and a few pieces for The Conversation, and some ad-hoc blogging as a minor player on the mindhacks.com blog. I self published an e-book ‘For argument’s sake: evidence that reason can change minds‘ which was very briefly the 8th most popular experimental psychology e-book on Amazon (1 place behind ’50 sexting tips for women’).

Engagement: The year began with me on a sabbatical, which I spent at Folksy. Thanks to everyone there who made it such an enjoyable experience. I learnt more observing small business life in my home city than I think I would have in another Psychology department on the other side of the world. This year I was also lucky enough to do some work with 2CV related to a Transport for London brief on applying behavioural science to passenger behaviours, with Comparethemarket.com on understanding customer decisions and with McGraw-Hill Education on analysis of student learning. Our work on decision biases in court was also kindly mentioned on the UK parliament website, but I have to say that my getting-out-of-the-university highlight of the year was appearing in the promotional video for Folksy’s drone delivery project (released 1/4/2015).

Research: We rebooted interdisciplinary Cognitive Science activities at Sheffield with a Workshop, several seminars and a mailing list for everyone to keep in touch. Kudos to Luca for help instigating these things.

Several existing grants kept me very busy:

Our Leverhulme grant on Bias & Blame continued with our investigation into the cognitive foundation and philosophical implications of implicit bias. The PI, Jules Holroyd was awarded a prestigious Vice Chancellor’s Fellowship at Sheffield, so she’ll be a colleague in the new year as well as a collaborator (well done Jules!).  As part of this project we pre-registered an experimental test of our core hypothesis and this December Robin Scaife finished a heroic effort in data collection, so expect results on this in the new year. Pre-registration was an immensely informative process, not least because it made me finally take power analysis seriously (previously I just sought to side-step the issue). As a result of this work on decision making and implicit bias I did training for employment tribunal judges on bias in decision making, during which I probably learnt more from them than they learnt from me.

We’ve been scanning at the York Neuroimaging Centre, as part of our project on ‘Neuroimaging as a marker of Attention Deficit Hyperactivity Disorder (ADHD)’ . One of the inspirations for this project, Maria Panagiotidi, passed her PhD viva in November for her thesis titled: ‘The Role of the Superior Colliculus in Attention Deficit Hyperactivity Disorder’. Congratulations to Maria, who goes on to work as a research psychologist for Arctic Shores in Manchester.

Funded by the Michael J Fox Foundation we’d continued testing in Sheffield and Madrid, using typing as a measure of the strength of habitual behaviour in Parkinson’s Disease. For this grant the heroic testing efforts were performed by Mariana Leriche. For the analysis we are combing timing information (my specialty) and an information theoretic analysis based on language structure. Colin Bannard (University of Liverpool) is leading on this part of the analysis and working with him has been a great pleasure and immensely informative on computational linguistics.

Our students as part of the Sheffield Neuroeconomics network approach their final years. Angelo Pirrone and I have been working with James Marshall in Computer Science on perceptual decision making, and fitting models of decision making.

That’s not all, but that is all for now. The greatest pleasure of the year has been all the people I’ve had a chance to work with; students, colleagues and collaborators. Everything I have done this year has been teamwork. So apologies if you’re not mentioned above – it is only due to lack of space, not lack of appreciation – and my best wishes for 2016.

Written by Comments Off on 2015 review Posted in events

Crowdsourcing analysis, an alternative approach to scientific research

Crowdsourcing analysis, an alternative approach to scientific research: Many Hands make tight work

Guest Lecture by Raphael Silberzahn, IESE Business School, University of Navarra

11:00 – 12:00, 9th of December, 2015

Lecture Theatre 6, The Diamond (32 Leavygreave Rd, Sheffield S3 7RD)

Is soccer players’ skin colour associated with how often they are shown a red card? The answer depends on how the data is analysed. With access to a dataset capturing the player-referee interactions of premiership players from the 2012-13 season in the English, German, French and Spanish leagues we organised a crowdsourced research project involving 29 different research teams and 61 individual researchers. Teams initially exchanged analytical approaches — but not results — and incorporated feedback from other teams into their analyses. Despite, the teams came to a broad range of conclusions. The overall group consensus (that a correlation exists) was much more tentative than would be expected from a single-team analysis. Raphael Silberzahn will provide insights from his perspective as one of the project coordinators and Tom Stafford will speak about his experience as a participant in this project. We will discuss how also smaller research projects can benefit from bringing together teams of skilled researchers to work simultaneously on the same data and thereby balance discussions and provide scientific findings with greater validity.

Links to coverage of this research in Nature (‘Crowdsourced research: Many hands make tight work’), and on FiveThirtyEight (‘Science Isn’t Broken: It’s just a hell of a lot harder than we give it credit for’). Our group’s analysis was supported by some great data exploration and visualisation work led by Mat Evans. You can see an interactive notebook of this work here

 

Written by Comments Off on Crowdsourcing analysis, an alternative approach to scientific research Posted in Research, events

Event: Crowdsourcing Psychology Data – Online, Mobile and Big Data approaches

StaffordFig3Smart phones, social media and networked sensors in everything from trains to toasters – The spread of digital technology creates new opportunities for cognitive scientists. Collecting and analysing the resulting “big data” also poses its own special challenges. This afternoon of talks and discussion is suitable for anyone curious about novel data collection and analysis strategies and how they can be deployed in psychological and behavioural research.

Time: 1pm-5pm, 11th of November 2014

Venue: Department of Psychology, University of Sheffield

We have four speakers followed by a panel discussion. Our speakers:

Martin Thirkettle: “Taking cognitive psychology to the small screen: Making a research focussed mobile app”

Developing a mobile app involves balancing a number of parties – researchers, funders, ethics committees, app developers, not to mention the end users. As the Open University’s “Brainwave” app, our first research-focussed cognitive psychology app, nears launch, I will discuss some of the challenges we’ve faced during the development process.

Caspar Addyman: “Measuring drug use with smartphones: Some misadventures”

Everyday drug use and its effects are not easily captured by lab or survey-based research. I developed the Boozerlyzer, an app that let people log their alcohol intake, their mood and play simple games that measured their cognitive and emotional responses. Although this had its flaws it led to a NHS funded collaboration to develop a simple smartphone tracker for Parkinson’s patients. Which was also problematic..

Robb Rutledge: “Crowdsourcing the cognitive science of decision making and well-being”

Some cognitive science questions can be particularly difficult to address in the lab. I will discuss results from The Great Brain Experiment, an app that allowed us to develop computational models for how decision making changes across the lifespan, and also how rewards and expectations relate to subjective well-being.

Andy Woods: “[C]lick your screen: probing the senses online”

We are at the cusp of some far-reaching technological advances that will be of tremendous benefit to research. Within a few short years we will be able to test thousands of people from any demographic with ‘connected’ technology every bit as good as we use in our labs today — indeed perhaps more so. Here I discuss on-web versus in-lab, predicted technological advances and issues with online research.

Tickets are free and available: here.

Written by Comments Off on Event: Crowdsourcing Psychology Data – Online, Mobile and Big Data approaches Posted in events