Human Agent Collectives: The Power of the Crowd
An overview of ORCHID’s research in the crowdsourcing domain.
An overview of ORCHID’s research in the crowdsourcing domain.
Word-of-mouth, referral, or viral marketing is a highly sought-after way of advertising. We undertook a field experiment that compared incentive mechanisms for encouraging social media shares to promote participation in a crowdsourcing or citizen science project or to support a given cause. Our experiment took place on a website set up to promote a fundraising drive by a large cancer research charity. Site visitors who chose to sign up to support the cause were then asked to spread the word about the cause on Facebook, Twitter or other channels. Visitors were randomly assigned to one of four groups that differed in the way social sharing activities were incentivised. Under the control group, no extra incentive was provided. Under two others, the sharers were offered a fixed number of points that helped to take the campaign further. We compared low and high levels of such incentives for direct referrals. The final group, were offered a multi-level incentive mechanism that rewarded direct as well as indirect referrals (where referred contacts refer others). We found that providing a high level of incentives resulted in a statistically significant increase in sharing behaviour.
Combining machine intelligence with the skills of human crowds produces powerful systems for analysing data and meeting complexing information needs. For the TREC crowdsourcing challenge, we demonstrated a Bayesian probabilistic method for combining the responses of a crowd with features extracted using natural language processing, allowing a small number of crowdsourced labels to train a classifier. This automation reduces the cost of crowdsourcing and expands the size of datasets we can manage. Furthermore, Bayesian modelling approaches allow us to select optimal pairs of workers and tasks, vastly increasing the efficiency and speed of learning.
The New Forest Cicada is an insect native to the UK in great danger of becoming extinct. Several entomologists have searched for it in the past few years, but no sighting has been confirmed for over a decade. However, the area where the cicada could be found is vast, extending to the entire New Forest and potentially other sites in Southern England. This cicada makes a high-piched call that is difficult for adults to hear as it is at the edges of our ears’ frequency range.
Visitors to the New Forest may use their smartphones to capture and classify the sound produced by the cicada, effectively mapping where the insect can or cannot be found. A smartphone “app” to classify the call has been developed and can be downloaded from the New Forest Cicada Website.
Understanding human mobility patterns is a significant research endeavour that has recently received considerable attention. Developing the science to describe and predict how people move from one place to another during their daily lives promises to address a wide range of societal challenges: from predicting the spread of infectious diseases, improving urban planning, to devising effective emergency response strategies. Individuals are also set to benefit from this area of research, as mobile devices will be able to analyse their mobility pattern and offer context-aware assistance and information. For example, a service could warn about travel disruptions before the user is likely to encounter them, or provide recommendations and mobile vouchers for local services that promise to be of high value to the user, based on their predicted future plans. More ambitiously, control systems for home heating and electric vehicle charging could be enhanced with knowledge of when the user will be home.
We developed a novel trust-based method for learning from information provided from untrustworthy responders (or sensors) in disaster environments. Specifically, our method is derived from the integration of a sensor trust model with the Gaussian process and it is able to estimate jointly the observed spatial function and the individual sensor’s trustworthiness. The video shows the application of such a method to the scenario of crowdsourced radiation monitoring in the 2011 Fukushima disaster.
A web-based demo is available here
The Tag Challenge sent five individuals to roam the streets of New York, Washington DC, Bratislava, Stockholm, and London on March 31, 2012. The challenge was to locate them based only on a single photo of each individual released at 8am. ORCHID researchers joined scientists from Masdar Institute and UCSD to form the CrowdScanner team and win this seemingly impossible challenge. The lessons from the challenge appeared in Computer magazine and The Economist. This research will guide the design of future information-gathering crowdsourcing and citizen science projects.
We have recently developed a methodology for extracting social network structure from spatio-temporal datasets that describe timestamped occurrences of individuals. Our approach identifies temporal regions of dense agent activity and links are drawn between individuals based on their co-occurrences across these ‘gathering events’. The statistical significance of these connections is then tested against an appropriate null model. Such a framework allows us to exploit the wealth of analytical and computational tools of network analysis in settings where the underlying connectivity pattern between interacting agents (commonly termed the adjacency matrix) is not given a priori. As part of this work we have performed experiments on two large-scale datasets (with millions of data points) of great tit (Parus major) wild bird foraging records and illustrate the use of this approach by examining the temporal dynamics of pairing behaviour, a process that was previously very hard to observe. We show that established pair bonds are maintained continuously, whereas new pair bonds form at variable times before breeding, but are characterized by a rapid development of network proximity. The method proposed is general, and can be applied to any system with information about the temporal co-occurrence of interacting agents.
This work was supported by Microsoft Research.
The Zooniverse Labs platform has been developed to allow machine learning algorithms and predictive models developed within ORCHID to be plugged in to improve human performance in galaxy identification tasks. The firt project in the labs has been launched and concerns searching for interesting signals coming from the Kepler Field. The hope is that we will find another planet!