The University of Southampton
Telephone:
+442380597678
Email:
jsh2@ecs.soton.ac.uk

Dr Jonathon Hare 

Personal homepage
http://github.com/jonhare
http://twitter.com/jon_hare
http://arxiv.org/a/hare_j_4.html
https://scholar.google.co.uk/citations?user=UFeON5oAAAAJ
  • Associate Professor of Computer Science
  • Director of Programmes (Computer Science)

I am an Associate Professor in the School of Electronics & Computer Science. I hold a BEng degree in Aerospace Engineering and PhD in Computer Science, both from the University of Southampton. My main research interests are centred around learnt representations of data. This is a subtopic of machine learning in which machines learn to encode or embed raw data into representations (aka latent spaces or embeddings) that attempt to capture human notions of meaning and semantics, and disentangle the underlying factors that generated the data.

My research necessarily incorporates research into deep neural network models ("deep learning"), as well as the more general notion of differentiable programming. Much of my research focusses on representations of visual information, and hence crosses over into the field of computer vision. I have however also worked on representations of textual information and other data modalities, and I am particularly interested in representations at the convergence of different modalities of data. At the same time, I am also highly interested in how we can take inspiration from biological systems in the design of our models, and both use this to inform new model architectures (that for example have particular performance characteristics, or map particularly well to certain hardware), as well as to understand emergent representational properties inside those models.

My research has been published in over 100 articles in top peer-reviewed journals and conferences. I am one of only a small handful of UK-based academics to have successively published papers in both NeurIPS and ICLR, the top international conferences for neural network, machine-learning and representation-learning research.

Research

Research interests

My main research interests lie in the area of representation learning. The long-term goal of my research is to innovate techniques that can allow machines to learn from and understand the information conveyed by data and use that information to fulfil the information needs of humans.  Broadly speaking this can be broken down into the following areas:

Novel representation

I have worked on a number of different approaches to creating novel representations from data. These include:

  • New units for representing different data types: With Yan Zhang & Adam Prügel-Bennett, I’ve worked developing differentiable neural architectures for counting and working with unordered sets. 
  • Embedding and Disentanglement: I’ve worked on a number of aspects of learning joint embeddings of different modalities of data. Recently with Matthew Painter, Adam Prügel-Bennett and I have looked at how underlying latent processes might be disentangled.
  • Learning architectures under constraints: In recent work with Sulaiman Sadiq, Geoff Merrett and I have started to look at how neural architectures for representation might be themselves learned to optimise against certain hardware constraints. Also related to this theme is joint work with Enrique Marquez and Mahesan Niranjan on Cascade Learning of deep networks, which allows a network to be grown from the bottom up.
  • Representational translation: with Pavlos Vougiouklis I’ve worked a lot on the problem of translating structured data into a representational space that can then be translated into a human readable text; in short we trained neural networks to translate sets of <subject, predicate, object> triples into natural language descriptions.
  • Acceleration features: with Yan Sun and Mark Nixon, I’ve developed novel representations for image sequences based on higher orders of motion such as acceleration and jerk. These representations can for example be used as an intermediary in recognition tasks.
  • Soft Biometric representation: with Nawaf Almudhahka and Mark Nixon, I’ve developed new forms soft-biometric representation that allow photographs of people to be recognised from verbal descriptions.

Understanding representation and taking inspiration from biology

As we work towards the goal of building artificial intelligence, it is important that we understand how our models work internally, and perhaps even utilise knowledge of biological systems in their design. In this space, there are three main directions that stand out:

  • Relating behaviours and internal representations of deep networks to biology: with Daniela Mihai and Ethan Harris, we’ve been working to understand what factors of a neural architecture cause the emergence of particular cell-level properties. In recent work we’ve explored how neural bottlenecks in artificial visual systems give rise to colour opponent cellular properties observed in real biological systems.
  • Investigating the emergence of visual semantics: Daniela Mihai & I have been exploring what factors cause visual semantics to emerge from artificial agents parameterised by neural networks when they play a visual communication game.
  • In ongoing work with colleagues as part of the EPSRC International Centre for Spatial Computational Learning, we’re considering if certain observations from biological neural networks, such as sparsity and overall architecture, could be used to help develop new ways of designing network models to better fit existing hardware, and better inform the development of future neural network hardware.

Applications of representation

  • Learning representations of aerial imagery: With colleagues from Ordnance Survey and Lancaster University I’ve spent a lot of time investigating new ways of learning representations that have applications in the geospatial intelligence domain. With Iris Kramer, we’ve been investigating how deep learning and representation learning technologies can be applied to allow for the discovery of archaeological sites from aerial imagery and LiDaR data.
  • Learning representations of scanned text documents. I was the Investigator of the Innovate UK funded Transcribe AI project, which looked at ways of learning representations of scanned textual documents that would allow for automated information extraction and reasoning over the information that was conveyed. 

I have also been involved in numerous other projects involving both machine learning and computer vision. For example, I was part of a team that innovated a system for scanning archaeological artefacts in the form of ancient Near Eastern cylinder seals using structured light.

Through all my research, I have made a commitment to open science and reproducible results. The published outcomes of almost all my work is accompanied with open source implementations that others can view, modify and run. A large body of the outcomes of my earlier research can be found in the OpenIMAJ software project (see http://openimaj.org), which won the prestigious 2011 ACM Multimedia Open Source Software Competition. OpenIMAJ is now used by researchers and developers across the globe, and in a variety of national and international organisations.

Teaching

I currently lead and teach on our popular research-led undergraduate Computer Vision and fourth year/MSc Differentiable Programming/Deep Learning modules. I am also part of the teaching team (with Adam Prügel-Bennett) on the Advanced Machine Learning module. In the past I have also taught the fourth year/MSc Data Mining module which I designed, and Scripting Languages/Cloud Application Development.

My work on designing and delivering these modules has been widely recognised: For Computer Vision, the students nominated me for the 2013-14 Excellence in Teaching Awards, and I won the faculty award for innovative teaching. In 2015 I was awarded a Vice Chancellors Teaching Award. The Computer Vision module was also shortlisted in the Blackboard and VLE Awards in 2017 and 2020, and my Data Mining module was shortlisted in 2016. 

I am actively involved in matters surrounding teaching in the School, such as engaging with education away days, education committee, and School reviews. In particular I was heavily involved in the review of machine learning teaching which led to the creation of new modules on Deep LearningNatural Language Processing and Machine Learning Technologies.

As Doctoral Programme Director, I am currently also responsible for the education of over 150 PhD students. Through these activities I contribute directly to education policy. I am also heavily involved in the organisation of outreach activities, including the ECS Taster Course

Together with Adam Prügel-Bennett and Mahesan Niranjan, I am also regularly involved in contract teaching of short courses on Machine Learning to both academia and industry.

I am a Fellow of the HEA and act as a mentor to ECS colleagues undertaking PGCAP and PREP.

Publications

Yardley, Lucy, Osmond, Adrian, Hare, Jonathon, Wills, Gary, Weal, Mark, De Roure, Dave and Michie, Susan (2009) Introduction to the LifeGuide: software facilitating the development of interactive internet interventions. In Proceedings of the Persuasive Technology and Digital Behaviour Intervention Symposium.

Joseph, J.A., Yardley, Lucy, Hare, J., Osmond, A, Yang, Yang, Weal, Mark J., Wills, Gary B. and Michie, S (2009) Application of the LifeGuide: the development and quantitative analysis of the 'Internet Doctor'. 5th International Conference on e-Social Science, , Cologne, Germany. 24 - 26 Jun 2009. 6 pp .

Hare, Jonathon S. and Lewis, Paul H. (2003) Scale Saliency: Applications in Visual Matching, Tracking and View-Based Object Recognition. Distributed Multimedia Systems 2003 / Visual Information Systems 2003, Florida International University, Miami, Florida, United States. 23 - 25 Sep 2003. pp. 436-440 .

Hare, Jonathon S. and Lewis, Paul H. , Enser, Peter, Kompatsiaris, Yiannis and O'Connor, Noel E. (eds.) (2004) Salient Regions for Query by Image Content. Lecture Notes in Computer Science, 3115 /, 317-325.

Hare, Jonathon S. and Lewis, Paul H. (2005) Content-based image retrieval using a mobile device as a novel interface. Lienhart, Rainer W., Babaguchi, Noburu and Chang, Edward Y. (eds.) Storage and Retrieval Methods and Applications for Multimedia 2005, San Jose, California, United States. 16 - 20 Jan 2005. pp. 64-75 .

Hare, Jonathon S. and Lewis, Paul H. (2005) Saliency-based Models of Image Content and their Application to Auto-Annotation by Semantic Propagation. Multimedia and the Semantic Web / European Semantic Web Conference 2005, Heraklion, Crete.

Hare, Jonathon S. and Lewis, Paul H. , Leow, Wee-Kheng, Lew, Michael S., Chua, Tat-Seng, Ma, Wei-Ying, Chaisorn, Lekha and Bakker, Erwin M. (eds.) (2005) On Image Retrieval using Salient Regions with Vector-Spaces and Latent Semantics. Lecture Notes in Computer Science, LNCS 3, 540-549.

Hare, Jonathon, Karam, Maria, Lewis, Paul and schraefel, m.c. (2005) iGesture: A Platform for Investigating Multimodal, Multimedia Gesture-based Interactions s.n.

Hare, Jonathon S., Lewis, Paul H., Enser, Peter G. B. and Sandom, Christine J. (2006) Mind the Gap: Another look at the problem of the semantic gap in image retrieval. Chang, Edward Y., Hanjalic, Alan and Sebe, Nicu (eds.) Multimedia Content Analysis, Management and Retrieval 2006, San Jose, California, United States. 17 - 19 Jan 2006. pp. 607309-1 .

Karam, Maria, Hare, Jonathon, Lewis, Paul and schraefel, m.c. (2006) Ambient Gestures s.n.

Hare, Jonathon S. (2006) Saliency for Image Description and Retrieval. University of Southampton, School of Electronics and Computer Science, Doctoral Thesis.

Hare, Jonathon S., Sinclair, Patrick A. S., Lewis, Paul H., Martinez, Kirk, Enser, Peter G.B. and Sandom, Christine J. (2006) Bridging the Semantic Gap in Multimedia Information Retrieval: Top-down and Bottom-up approaches. Bouquet, Paolo, Brunelli, Roberto, Chanod, Jean-Pierre, Niederée, Claudia and Stoermer, Heiko (eds.) Mastering the Gap: From Information Extraction to Semantic Representation / 3rd European Semantic Web Conference, Budva, Montenegro.

Tang, Jiayu, Hare, Jonathon S. and Lewis, Paul H. (2006) Image Auto-annotation using a Statistical Model with Salient Regions. IEEE International Conference on Multimedia &amp; Expo (ICME), Hilton Toronto, Toronto, Ontario, Canada. 08 - 11 Jul 2006.

Hare, Jonathon S., Lewis, Paul H., Enser, Peter G. B. and Sandom, Christine J. , Sundaram, Hari, Naphade, Milind, Smith, John R. and Rui, Yong (eds.) (2006) A Linear-Algebraic Technique with an Application in Semantic Image Retrieval. Lecture Notes in Computer Science, LNCS 4, 31-40. (doi:10.1007/11788034_4).

Enser, Peter G. B., Sandom, Christine J., Lewis, Paul H. and Hare, Jonathon S. (2006) The Reality of the Semantic Gap in Image Retrieval. The Reality of the Semantic Gap in Image Retrieval, tutorial held in conjunction with the 1st International Conference on Semantic and Digital Media Technologies, Athens, Greece.

Hare, Jonathon S., Lewis, Paul H., Enser, Peter G. B. and Sandom, Christine J. (2007) How to spot a Dalmatian in a pack of Dogs; A data-driven approach to searching unannotated images using natural language. Multimedia Knowledge Management: Industry meets academia, KMi, Open University, Milton Keynes.

Wills, Gary, Davis, Hugh, Gilbert, Lester, Hare, Jonathon, Howard, Yvonne, Jeyes, Steve, Millard, David and Sherratt, Robert (2007) Delivery of QTIv2 Question Types. International CAA Conference, Loughborough, United Kingdom. 09 - 10 Jul 2007.

Hare, Jonathon S., Lewis, Paul H., Enser, Peter G. B. and Sandom, Christine J. (2007) Semantic Facets: An in-depth Analysis of a Semantic Image Retrieval System. ACM CIVR 2007: The 6th International Conference on Image and Video Retrieval, Amsterdam, The, Netherlands. 08 - 10 Jul 2007.

Enser, Peter G. B., Sandom, Christine J., Hare, Jonathon S. and Lewis, Paul H. (2007) Facing the reality of semantic image retrieval. Journal of Documentation, 63 (4), 465-481.

Hare, Jonathan, Sinclair, Patrick, Lewis, Paul and Martinez, Kirk (2008) Giving order to image queries. Gevers, Theo, Jain, Ramesh and Santini, Simone (eds.) Multimedia Content Access: Algorithms and Systems II, San Jose, California, United States. 30 - 31 Jan 2008. pp. 682005-1 .

Hare, Jonathan, Lewis, Paul, Gordon, Layla and Hart, Glenn (2008) MapSnapper: Engineering an Efficient Algorithm for Matching Images of Maps from Mobile Phones. Gevers, Theo, Jain, Ramesh and Santini, Simone (eds.) Multimedia Content Access: Algorithms and Systems II, San Jose, California, United States. 30 - 31 Jan 2008. 68200L-1 .

Wills, Gary, Davis, Hugh, Gilbert, Lester, Hare, Jonathon, Howard, Yvonne, Jeyes, Steve, Millard, David and Sherratt, Robert (2009) Delivery of QTIv2 question types. [in special issue: Emerging Frameworks for the Use of E-Assessment in Higher Education] Assessment & Evaluation in Higher Education, 34 (3), 353-366. (doi:10.1080/02602930802071106).

Wills, Gary, Gilbert, Lester, Hare, Jonathan, Kajaba, Jiri, Argles, David and Millard, David (2008) Assessment Delivery Engine for QTIv2 Tests. 4th Ten Competence Open Workshop, Madrid. 09 - 10 Apr 2008.

Wills, Gary, Hare, Jonathan, Kajaba, Jiri, Argles, David, Gilbert, Lester and Millard, David (2008) A delivery engine for QTI assessments. International Journal of Emerging Technologies in Learning (iJET), 3. (PMID:10.3991%2Fijet.v3i0.551)

Wills, Gary, Hare, Jonathan, Kajaba, Jiri, Argles, David, Gilbert, Lester and Millard, David (2008) Assessment delivery engine for QTIv2 tests. International CAA Conference, Loughborough, United Kingdom. 07 - 08 Jul 2008. 10 pp .

Hare, Jonathan, Samangooei, Sina, Lewis, Paul and Nixon, Mark (2008) Semantic spaces revisited: investigating the performance of auto-annotation and semantic retrieval using semantic spaces. CIVR '08: The 2008 international conference on Content-based image and video retrieval, Niagara Falls, Ontario, Canada. 06 - 08 Jul 2008. pp. 359-368 .

Sandom, Christine, Hare, Jonathan, Enser, Peter and Lewis, Paul (2007) Bridging the Semantic Gap in Visual Information Retrieval: End of Project Report s.n. (In Press)

Hare, Jonathan, Osmond, Adrian, Yang, Yang, Wills, Gary, Weal, Mark, De Roure, David, Joseph, Judith and Yardley, Lucy (2009) LifeGuide: a platform for performing web-based behavioural interventions. WebSci'09: Society On-Line, , Athens, Greece. 18 - 20 Mar 2009. 5 pp .

Osmond, Adrian, Hare, Jonathan, Price, Joseph, Smith, Ashley, Weal, Mark, Wills, Gary, Yang, Yang, Yardley, Lucy and De Roure, David (2009) Designing authoring tools for the creation of on-line behavioural interventions. 5th International Conference on e-Social Science, , Cologne, Germany. 24 - 26 Jun 2009. 10 pp .

Hare, Jonathan and Lewis, Paul (2009) IAM@ImageCLEFPhotoAnnotation 2009: Naïve application of a linear-algebraic semantic space. Borri, Francesca, Nardi, Alessandro and Peters, Carol (eds.) CLEF 2009 Workshop, Corfu, Greece. 29 Sep - 01 Oct 2009. p. 66 .

Hare, Jonathan, Dupplaw, David and Lewis, Paul (2009) IAM@ImageCLEFphoto 2009: Experiments on Maximising Diversity using Image Features. Borri, Francesca, Nardi, Alessandro and Peters, Carol (eds.) CLEF 2009 Workshop, Corfu, Greece. 29 Sep - 01 Oct 2009. p. 42 .

Zontone, Pamela, Boato, Giulia, De Natale, F. G. B., De Rosa, Alessia, Barni, Mauro, Piva, Alessandro, Hare, Jonathan, Dupplaw, David and Lewis, Paul (2009) Image diversity analysis: context, opinion and bias. The First International Workshop on Living Web: Making Web Diversity a true asset, Collocated with the 8th International Semantic Web Conference ISWC-2009, Westfields Conference Center, Washington DC., United States.

Hare, Jonathan and Lewis, Paul (2010) Semantic Retrieval and Automatic Annotation: Linear Transformations, Correlation and Semantic Spaces. Imaging and Printing in a Web 2.0 World; and Multimedia Content Access: Algorithms and Systems IV, San Jose, California, United States. 17 - 21 Jan 2010.

Hare, Jonathan and Lewis, Paul (2010) Automatically Annotating the MIR Flickr Dataset: Experimental Protocols, Openly Available Data and Semantic Spaces. MIR '10: Proceedings of the international conference on Multimedia information retrieval, Philadelphia, United States. 28 - 30 Mar 2010. pp. 547-556 .

Zontone, Pamela, Boato, Giulia, Hare, Jonathon, Lewis, Paul, Siersdorfer, Stefan and Minack, Enrico (2010) Image and Collateral Text in Support of Auto-annotation and Sentiment Analysis. TextGraphs-5: Graph-based Methods for Natural Language Processing, Uppsala, Sweden. pp. 88-92 .

Siersdorfer, Stefan, Hare, Jonathon, Minack, Enrico and Deng, Fan (2010) Analyzing and Predicting Sentiment of Images on the Social Web. ACM Multimedia 2010, Firenze, Italy. 24 - 28 Oct 2010. pp. 715-718 .

Yardley, Lucy, Osmond, Adrian, Hare, Jonathan, Wills, Gary, Weal, Mark, De Roure, David and Michie, Susan (2009) Introduction to the LifeGuide: software facilitating the development of interactive behaviour change internet interventions. Persuasive Technology and Digital Behaviour Intervention Symposium. (AISB 2009), Edinburgh, United Kingdom. 05 - 08 Apr 2009. 4 pp .

Hare, Jonathon, Samangooei, Sina and Lewis, Paul (2011) Efficient clustering and quantisation of SIFT features: Exploiting characteristics of the SIFT descriptor and interest region detectors under image inversion. The ACM International Conference on Multimedia Retrieval (ICMR 2011), Trento, Italy. 16 - 19 Apr 2011.

Hare, Jonathan, Samangooei, Sina and Dupplaw, David (2011) OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia Analysis and Indexing of Images. ACM Multimedia 2011, Scottsdale, Arizona, United States. 28 Nov - 01 Dec 2011. pp. 691-694 .

Hare, Jonathon, Samangooei, Sina, Dupplaw, David and Lewis, Paul H. (2012) ImageTerrier: an extensible platform for scalable high-performance image retrieval. ACM International Conference on Multimedia Retrieval (ICMR'12), Hong Kong, Hong Kong. 04 - 07 Jun 2012. 8 pp .

Zerr, Sergej, Siersdorfer, Stefan, Hare, Jonathon and Demidova, Elena (2012) I know what you did last summer! - privacy-aware image classification and search. SIGIR '12, Portland, United States. 11 - 15 Aug 2012. 10 pp .

Hare, Jonathon S., Samangooei, Sina and Lewis, Paul H. (2012) Practical scalable image analysis and indexing using Hadoop. Multimedia Tools and Applications, 1-34. (doi:10.1007/s11042-012-1256-0).

Zerr, Sergej, Siersdorfer, Stefan and Hare, Jonathon (2012) PicAlert!: a system for privacy-aware image classification and retrieval. 21st ACM Conference on Information and Knowledge Management (CIKM 2012), Maui, Hawaii, United States. 29 Oct - 02 Nov 2012.

Packer, Heather S., Hare, Jonathon S., Samangooei, Sina and Lewis, Paul (2012) Semantically Tagging Images of Landmarks. Knowledge extraction and consolidation from social media (KECSM) 2012 Workshop, Boston, MA, United States.

Packer, Heather S., Samangooei, Sina, Hare, Jonathon S., Gibbins, Nicholas and Lewis, Paul (2012) Event Detection using Twitter and Structured Semantic Query Expansion. CrowdSens 2012 Workshop, Maui, HI, United States.

Hall, Wendy, Tiropanis, Thanassis, Tinati, Ramine, Booth, Paul, Gaskell, Paul, Hare, Jonathon and Carr, Les (2013) The Southampton University Web Observatory. 1st International workshop on Building Web Observatories, ACM Web Science 2013, 1-3 May 2013.

Hare, Jonathon, Samangooei, Sina, Dupplaw, David and Lewis, Paul H. (2013) Twitter's visual pulse. the 3rd ACM conference on International conference on multimedia retrieval, Dallas, United States. pp. 297-298 . (doi:10.1145/2461466.2461514).

Hare, Jonathon and Lewis, Paul H. (2013) Explicit diversification of image search. the 3rd ACM conference on International conference on multimedia retrieval, Dallas, United States. pp. 295-296 . (doi:10.1145/2461466.2461513).

Hare, Jonathon, Dupplaw, David, Hall, Wendy, Lewis, Paul H. and Martinez, Kirk (2013) Building a Multimedia Web Observatory Platform. Building Web Observatories, Paris, France.

Hare, Jonathon, Samangooei, Sina and Dupplaw, David (2013) OpenIMAJ – Intelligent Multimedia Analysis in Java. ACM SIGMM Records. (In Press)

Hare, Jonathon, Acosta, Maribel, Weston, Anna, Simperl, E., Samangooei, Sina, Dupplaw, David and Lewis, Paul H. (2013) An investigation of techniques that aim to improve the quality of labels provided by the crowd. MediaEval 2013 / Crowdsourcing for Social Multimedia, Barcelona, Spain. (In Press)

Jain, Neha, Hare, Jonathon, Samangooei, Sina, Preston, John, Davies, Jamie, Dupplaw, David and Lewis, Paul H. (2013) Experiments in Diversifying Flickr Result Sets. MediaEval 2013 / Retrieving Diverse Social Images, Barcelona, Spain.

Davies, Jamie, Hare, Jonathon, Samangooei, Sina, Preston, John, Jain, Neha, Dupplaw, David and Lewis, Paul H. (2013) Identifying the Geographic Location of an Image with a Multimodal Probability Density Function. MediaEval 2013 / Placing: Geo-coordinate Prediction for Social Multimedia, Barcelona, Spain. (In Press)

Samangooei, Sina, Hare, Jonathon, Dupplaw, David, Niranjan, Mahesan, Gibbins, Nicholas, Lewis, Paul H., Davies, Jamie, Jain, Neha and Preston, John (2013) Social Event Detection via sparse multi-modal feature selection and incremental density based clustering. MediaEval 2013 / Social Event Detection for Social Multimedia, Barcelona, Spain. (In Press)

Preston, John, Hare, Jonathon, Samangooei, Sina, Davies, Jamie, Jain, Neha, Dupplaw, David and Lewis, Paul H. (2013) A Unified, Modular and Multimodal Approach to Search and Hyperlinking Video. MediaEval 2013 / Search and Hyperlinking of Television Content, Barcelona, Spain. (In Press)

Hare, Jonathon S., Dupplaw, David, Hall, Wendy, Lewis, Paul and Martinez, Kirk (2013) The role of multimedia in archiving community memories. 1st International Workshop on Archiving Community Memories, Lisbon, Portugal. (In Press)

Maynard, Diana, Dupplaw, David and Hare, Jonathon (2013) Multimodal Sentiment Analysis of Social Media. BCS SGAI Workshop on Social Media Analysis.

Dupplaw, David, Matthews, Michael, Johansson, Richard, Boato, Giulia, Costanzo, Andrea, Fontani, Marco, Minack, Enrico, Demidova, Elena, Blanco, Roi, Griffiths, Thomas, Lewis, Paul H., Hare, Jonathon and Moschitti, Alessandro (2014) Information extraction from multimedia web documents: an open-source platform and testbed. International Journal of Multimedia Information Retrieval, 3 (2), 97-111. (doi:10.1007/s13735-014-0051-2).

Hare, Jonathon, Davies, Jamie, Samangooei, Sina and Lewis, Paul H. (2014) Placing Photos with a Multimodal Probability Density Function. International Conference on Multimedia Retrieval (ICMR'14), Glasgow, United Kingdom. (doi:10.1145/2578726.2578768).

Hare, Jonathon, Dupplaw, David, Lewis, Paul H., Hall, Wendy and Martinez, Kirk (2014) Exploiting multimedia in creating and analysing multimedia Web archives. [in special issue: Archiving Community Memories] Future Internet, 6 (2), 242-260. (doi:10.3390/fi6020242).

Maynard, Diana, Dietze, Stefan, Peters, Wim and Hare, Jonathon (2012) Proceedings of the 1st International Workshop on Knowledge Extraction & Consolidation from Social Media (KECSM-2012), Boston, USA, November 12, 2012 (CEUR Workshop Proceedings, 895), Aachen, DE. CEUR-WS, 96pp.

Siersdorfer, Stefan, Zerr, Sergej, San Pedro, Jose and Hare, Jonathon (2014) NicePic! A system for extracting attractive photos from Flickr streams. 37th Annual International ACM SIGIR Conference ACM (SIGIR 2014), Broadbeach, Australia. 05 - 10 Jul 2014. (doi:10.1145/2600428.2611183).

Hare, Jonathon, Newman, David, Peters, Wim, Greenwood, Mark and Eggink, Jana (2014) SemanticNews: Enriching publishing of news stories University of Southampton

Loni, Babak, Hare, Jonathon, Georgescu, Mihai, Riegler, Michael, Morchid, Mohamed, Dufour, Richard and Larson, Martha (2014) Getting by with a little help from the crowd: optimal human computation approaches to social image labeling. CrowdMM 2014, Orlando, United States. 03 - 07 Nov 2014. 6 pp . (doi:10.1145/2660114.2660123).

Maynard, Diana and Hare, Jonathon (2015) Entity-based Opinion Mining from Text and Multimedia. In, Advances in Social Media Analysis. (Studies in Computational Intelligence, 602) Springer, pp. 65-86. (In Press) (doi:10.1007/978-3-319-18458-6).

Hare, Jonathon, Samangooei, Sina, Niranjan, Mahesan and Gibbins, Nicholas (2015) Detection of Social Events in Streams of Social Multimedia. International Journal of Multimedia Information Retrieval, 4 (4), 289-302. (doi:10.1007/s13735-015-0085-0).

Almudhahka, Nawaf, Nixon, Mark and Hare, Jonathon (2016) Human face identification via comparative soft biometrics. IEEE International Conference on Identity, Security and Behavior Analysis 2016 (ISBA 2016), Sendai, Japan. 29 Feb - 02 Mar 2016. 6 pp . (In Press)

Basford, Philip, Bragg, Graeme, Hare, Jonathon, Jewell, Mike, Martinez, Kirk, Newman, David, Pau, Reena, Smith, Ash and Ward, Tyler (2016) Erica the Rhino: a case study in using Raspberry Pi Single Board Computers for interactive art. [in special issue: Raspberry Pi Technology] ELECTRONICS,, 5 (3), 1-18. (doi:10.3390/electronics5030035).

Almudhahka, Nawaf Y., Nixon, Mark S. and Hare, Jonathon S. (2016) Unconstrained human identification using comparative facial soft biometrics. BTAS 2016: IEEE 8th International Conference on Biometrics Theory, Applications and Systems, Niagara Falls, United States. 05 - 08 Sep 2016. 6 pp .

Mrabet, Yassine, Vougiouklis, Pavlos, Kilicoglu, Halil, Gardent, Claire, Demner-Fushman, Dina, Hare, Jonathon and Simperl, Elena (2016) Aligning texts and knowledge bases with semantic sentence simplification. 2nd International Workshop on Natural Language Generation and the Semantic Web (WebNLG 2016), Edinburgh, United Kingdom. 04 - 07 Sep 2016. pp. 29-36 .

Vougiouklis, Pavlos, Hare, Jonathon and Simperl, Elena (2016) A neural network approach for knowledge-driven response generation. 26th International Conference on Computational Linguistics (COLING 2016), Osaka, Japan. 11 - 16 Dec 2016. 11 pp .

Sun, Yan, Hare, Jonathon and Nixon, Mark (2016) Detecting acceleration for gait and crime scene analysis. In 7th International Conference on Imaging for Crime Detection and Prevention (ICDP 2016) : Madrid, Spain 23 – 25 November 2016. Institution of Engineering and Technology. pp. 13-18 .

Almudhahka, Nawaf, Yousef, Nixon, Mark and Hare, Jonathon (2017) Automatic semantic face recognition. The 12th IEEE International Conference on Automatic Face and Gesture Recognition, , Washington, United States. 30 May - 03 Jun 2017. (doi:10.1109/FG.2017.31).

Piscopo, Alessandro, Vougiouklis, Pavlos, Kaffee, Lucie-Aimee, Frimelle, Phethean, Christopher, Hare, Jonathon and Simperl, Elena (2017) What do Wikidata and Wikipedia have in common? An analysis of their use of external references. In OpenSym '17: Proceedings of the 13th International Symposium on Open Collaboration. ACM. 10 pp . (In Press) (doi:10.1145/3125433.3125445).

Zhang, Ce, Pan, Xin, Li, Huapeng, Gardiner, Andy, Sargent, Isabel, Hare, Jonathon and Atkinson, Peter M. (2018) A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification. ISPRS Journal of Photogrammetry and Remote Sensing, 140, 133-144. (doi:10.1016/j.isprsjprs.2017.07.014).

Sargent, Isabel, Hare, Jonathon, Young, David, Wilson, Olivia, Doidge, Charis, Holland, David and Atkinson, Peter M. (2017) Inference and discovery in remote sensing data with features extracted using deep networks. Bramer, Max and Petridis, Miltos (eds.) In Artificial Intelligence XXXIV: SGAI 2017. vol. 10630, Springer. pp. 131-136 . (doi:10.1007/978-3-319-71078-5_10).

Almudhahka, Nawaf, Yousef, Nixon, Mark and Hare, Jonathon (2018) Semantic face signatures: recognizing and retrieving faces by verbal descriptions. IEEE Transactions on Information Forensics and Security, 13 (3), 706-716. (doi:10.1109/TIFS.2017.2765519).

Sun, Yan, Hare, Jonathon and Nixon, Mark (2017) Analysing acceleration for motion analysis. In The 13th International Conference on Signal Image Technology &amp; Internet Based Systems: Signal Image Technology &amp; Internet Based Systems. pp. 289-295 .

Kramer, Iris, Caroline, Hare, Jonathon, Prugel-Bennett, Adam and Sargent, Isabel (2017) Automated detection of archaeology in the New Forest using deep learning with remote sensor data. New Forest Knowledge Conference 2017: New Forest Historical Research and Archaeology: Who’s doing it?, Lyndhurst Community Centre, Lyndhurst, United Kingdom. 26 - 27 Oct 2017.

Kramer, Iris, Caroline, Hare, Jonathon and Prugel-Bennett, Adam (2017) Automation on steroids: an exploration of why deep learning is dominating automation. Aerial Archaeology Research Group 2017 Annual Meeting, , Pula, Croatia. 13 - 15 Sep 2017.

Kramer, Iris, Caroline, Hare, Jonathon and Prugel-Bennett, Adam (2017) Tackling the small data problem in deep learning with multi-sensor approaches. 46th Computer Applications and Quantitative Methods in Archaeology: Human History and Digital Future, , Tübingen, Germany. 19 - 23 Mar 2018. (In Press)

Kramer, Iris, Caroline, Hare, Jonathon and Prugel-Bennett, Adam (2017) A future perspective for automated detection of archaeology using deep learning with remote sensor data. ACM WomENcourage : Celebration of Women in Computing, Universitat Politecnica de Catalunya, Barcelona, Spain. 06 - 08 Sep 2017.

Elsahar, Hady, Vougiouklis, Pavlos, Remaci, Arslen, Gravier, Christophe, Hare, Jonathon, Simperl, Elena and Laforest, Frederique (2019) T-REx: A large scale alignment of natural language with knowledge base triples. In LREC 2018 - 11th International Conference on Language Resources and Evaluation. pp. 3448-3452 .

Marquez, Enrique, Salvador, Hare, Jonathon and Niranjan, Mahesan (2018) Deep cascade learning. IEEE Transactions on Neural Networks and Learning Systems, 29 (11), 5475-5485, [8307262]. (doi:10.1109/TNNLS.2018.2805098).

Zhang, Yan, Hare, Jonathon and Prügel-Bennett, Adam (2018) Learning to count objects in natural images for visual question answering. International Conference on Learning Representations, Vancouver Convention Center, Vancouver, Canada. 30 Apr - 03 May 2018. pp. 1-17 .

Sun, Yan, Hare, Jonathon and Nixon, Mark (2018) Detecting heel strikes for gait analysis through acceleration flow. IET Computer Vision, 12 (5), 686-692. (doi:10.1049/iet-cvi.2017.0429).

Zhang, Ce, Sargent, Isabel, Pan, Xin, Gardiner, Andy, Hare, Jonathon and Atkinson, Peter M. (2018) VPRS-based regional decision fusion of CNN and MRF classifications for very fine resolution remotely sensed images. IEEE Transactions on Geoscience and Remote Sensing, 56 (8), 1-15. (doi:10.1109/TGRS.2018.2822783).

Kaffee, Lucie-Aimée, Elsahar, Hady, Vougiouklis, Pavlos, Gravier, Christophe, Laforest, Frederique, Hare, Jonathon and Simperl, Elena (2018) Mind the (Language) Gap: Generation of Multilingual Wikipedia Summaries from Wikidata for ArticlePlaceholders. In The Semantic Web. vol. 10843, Springer. pp. 319-334 . (doi:10.1007/978-3-319-93417-4_21).

Kaffee, Lucie-Aimée, Elsahar, Hady, Vougiouklis, Pavlos, Gravier, Christophe, Laforest, Frederique, Hare, Jonathon and Simperl, Elena (2018) Learning to generate Wikipedia summaries for underserved languages from Wikidata. 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, , New Orleans, United States. 01 - 06 Jun 2018. 6 pp . (In Press)

Zhang, Ce, Sargent, Isabel, Pan, Xin, Li, Huapeng, Gardiner, A., Hare, Jonathon and Atkinson, Peter M. (2018) An object-based convolutional neural network (OCNN) for urban land use classification. Remote Sensing of Environment, 216, 57-70. (doi:10.1016/j.rse.2018.06.034).

Vougiouklis, Pavlos, Elsahar, Hady, Kaffee, Lucie-Aimée, Gravier, Christophe, Laforest, Frederique, Hare, Jonathon and Simperl, Elena (2018) Neural Wikipedian: generating textual summaries from knowledge base triples. Journal of Web Semantics, 52-53, 1-15. (doi:10.1016/j.websem.2018.07.002).

Vougiouklis, Pavlos, Maddalena, Eddy, Hare, Jonathon and Simperl, Elena (2018) How biased is your NLG evaluation? In Proceedings of the 1st CrowdBias Workshop. pp. 1-3 .

Nixon, Mark, Almudhahka, Nawaf and Hare, Jonathon (2018) Comparative face soft biometrics for human identification. In, Karampelas, P. and Bourlai, T. (eds.) Surveillance in Action: Advanced Sciences and Technologies for Security Applications. Springer. (doi:10.1007/978-3-319-68533-5_2).

Dahl, Jacob, Hare, Jonathon, Kelley, Kate, Martinez, Kirk and Young, David (2018) A structured light approach to imaging ancient Near Eastern cylinder seals: how efficient 3D imaging may facilitate corpuswide research. In, Kelley, Kaye and Wood, Rachel (eds.) Digital Imaging of Artefacts: Developments in Methods and Aims. (HASH(0xd5ee350)) Archaeopress / British Archaeological Reports, pp. 49-74.

Kaffee, Lucie-Aimée, Elsahar, Hady and Vougiouklis, Pavlos (2018) Wikidata2Wikipedia: Learning to Generate Wikipedia Summaries for Underserved Languages from Wikidata. University of Southampton [Dataset]

Mrabet, Yassine and Vougiouklis, Pavlos (2016) Aligning Texts and Knowledge Bases with Semantic Sentence Simplification. University of Southampton [Dataset]

Vougiouklis, Pavlos (2017) Neural Wikipedian: Generating Textual Summaries from Knowledge Base Triples. University of Southampton [Dataset]

Zhang, Yan, Hare, Jonathon and Prugel-Bennett, Adam (2019) Learning representations of sets through optimized permutations. International Conference on Learning Representations, Ernest N. Morial Convention Center, New Orleans, United States. 06 - 09 May 2019. 26 pp .

Zhang, Ce, Sargent, Isabel, Pan, Xin, Li, Huapeng, Gardiner, Andy, Hare, Jonathon and Atkinson, Peter M. (2019) Joint deep learning for land cover and land use classification. Remote Sensing of Environment, 221, 173-187. (doi:10.1016/j.rse.2018.11.014).

Zhang, Yan, Hare, Jonathon and Prugel-Bennett, Adam (2019) Deep set prediction networks. Sets &amp; Partitions: NeurIPS 2019 Workshop, Vancouver Convention Centre, West Level 2, #215-216, Vancouver, Canada. 14 Dec 2019.

Zhang, Yan, Hare, Jonathon and Prugel-Bennett, Adam (2019) FSPool: Learning set representations with featurewise sort pooling. Sets &amp; Partitions: NeurIPS 2019 Workshop, Vancouver Convention Centre, West Level 2, #215-216, Vancouver, Canada. 14 Dec 2019.

Zhang, Yan, Hare, Jonathon and Prugel-Bennett, Adam (2019) Deep set prediction networks. 2019 Conference on Neural Information Processing Systems, Vancouver Convention Center, Vancouver, Canada. 08 - 14 May 2019. pp. 1-11 .

Zhang, Yan, Hare, Jonathon and Prugel-Bennett, Adam (2020) FSPool: Learning set representations with featurewise sort pooling. International Conference on Learning Representations, Millennium Hall, Addis Ababa, Ethiopia. 26 - 30 Apr 2020.

Murray, Jon, Sargent, Isabel, Holland, David, Gardiner, A., Dionysopoulou, Kyriaki, Coupland, S., Hare, Jonathon and Atkinson, P (2019) Opportunities for machine learning and artificial intelligence in a national mapping agency: a perspective on enhancing ordnance survey workflow. In XXIV ISPRS Congress. vol. XXIV, International Society for Photogrammetry and Remote Sensing. 4 pp . (In Press)

Harris, Ethan William Albert, Niranjan, Mahesan and Hare, Jonathon (2019) Foveated convolutions: improving spatial transformer networks by modelling the retina. In Shared Visual Representations in Human and Machine Intelligence: 2019 NeurIPS Workshop. 8 pp .

Harris, Ethan William Albert, Mihai, Andreea Daniela and Hare, Jonathon (2019) Spatial and colour opponency in anatomically constrained deep networks. In Shared Visual Representations in Human and Machine Intelligence: 2019 NeurIPS Workshop. pp. 1-10 .

Vougiouklis, Pavlos, Maddalena, Eddy, Hare, Jonathon and Simperl, Elena (2020) Point at the triple: Generation of text summaries from knowledge base triples (Extended Abstract). In Proceedings of IJCAI-PRICAI 2020 Journal Track. International Joint Conferences on Artificial Intelligence.. (In Press)

Vougiouklis, Pavlos, Maddalena, Eddy, Hare, Jonathon and Simperl, Elena (2020) Point at the triple: generation of text summaries from knowledge base triples. Journal of Artificial Intelligence Research, 69, 1-31. (doi:10.1613/jair.1.11694).

Harris, Ethan William Albert, Mihai, Andreea Daniela and Hare, Jonathon (2020) How convolutional neural network architecture biases learned opponency and colour tuning. Neural Computation. (In Press)

Painter, Matthew, Hare, Jonathon and Prugel-Bennett, Adam (2020) Linear disentangled representations and unsupervised action estimation. Thirty-fourth Conference on Neural Information Processing Systems. 06 - 12 Dec 2020. (In Press)

Harris, Ethan William Albert, Mihai, Andreea Daniela and Hare, Jonathon (2020) Anatomically constrained ResNets exhibit opponent receptive fields; so what? In Shared Visual Representations in Human and Machine Intelligence: 2020 NeurIPS Workshop. 10 pp .

Sadiq, Sulaiman, Maji, Partha, Hare, Jonathon and Merrett, Geoff (2020) DEff-ARTS: differentiable efficient ARchiTecture search. NeurIPS 2020 Workshop on ML for Systems, , Vancouver, Canada.

Sun, Yan, Hare, Jonathon and Nixon, Mark (2020) On parameterizing higher-order motion for behaviour recognition. Pattern Recognition, 112, 1-9, [107710]. (doi:10.1016/j.patcog.2020.107710).

Tuddenham, Mark, Prugel-Bennett, Adam and Hare, Jonathon (2020) Quasi-Newton's method in the class gradient defined high-curvature subspace. 12th Annual Workshop on Optimization for Machine Learning, Virtual. 11 Dec 2020.

Xun, Lei (2021) Dataset for "Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platforms". University of Southampton doi:10.5258/SOTON/D1804 [Dataset]

Lou, Wei, Xun, Lei, Sabetsarvestani, Mohammadamin, Bi, Jia, Hare, Jonathon and Merrett, Geoff (2021) Dynamic-OFA: Runtime DNN architecture switching for performance scaling on heterogeneous embedded platforms. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops 2021. pp. 3104-3112 .

Xun, Lei, Al-Hashimi, Bashir, Hare, Jonathon and Merrett, Geoff (2021) Runtime DNN performance scaling through resource management on heterogeneous embedded platforms. tinyML EMEA Technical Forum 2021. 07 - 10 Jun 2021.

Parry, Hishan (2021) Dataset for "Dynamic Transformer for Efficient Machine Translation on Embedded Devices". University of Southampton doi:10.5258/SOTON/D1908 [Dataset]

Parry, Hishan, Xun, Lei, Sabetsarvestani, Mohammadamin, Bi, Jia, Hare, Jonathon and Merrett, Geoff (2021) Dynamic transformer for efficient machine translation on embedded devices. In 3rd ACM/IEEE Workshop on Machine Learning for CAD (MLCAD 2021). 6 pp .

Guthrie, Benjamin, Felix, Kim, Minkwan, Urrutxua, Hodei and Hare, Jonathon (2021) Image-based attitude determination of co-orbiting satellites enhanced with deep learning technologies. In Advances in the Astronautical Sciences. vol. 175, American Astronautical Society. pp. 3164-3182 . (In Press)

Guthrie, Benjamin, Felix, Kim, Minkwan, Urrutxua, Hodei and Hare, Jonathon (2021) Attitude reconstruction of an unknown co-orbiting satellite target using machine learning technologies. In Advances in the Astronautical Sciences. 18 pp . (Submitted)

Guthrie, Benjamin, Felix, Kim, Minkwan, Urrutxua, Hodei and Hare, Jonathon (2021) Image-based attitude determination of co-orbiting satellites using deep learning technologies. Aerospace Science and Technology, 120, [AESCTE_107232]. (doi:10.1016/j.ast.2021.107232).

Bi, Jia (2021) Dataset for "GhostShiftAddNet: More Features from Energy-Efficient Operations". University of Southampton doi:10.5258/SOTON/D2007 [Dataset]

Painter, Matthew, Prugel-Bennett, Adam and Hare, Jonathon (2020) On the structure of cyclic linear disentangled representations. NeurIPS2020 workshop on Interpretable Inductive Biases and Physically Structured Learning, Virtual, Vancouver, Canada. 12 Dec 2020. 4 pp .

Sabetsarvestani, Mohammadamin, Hare, Jonathon and Merrett, Geoffrey (2021) Data for Similarity-aware CNN for Efficient Video Recognition at the Edge. University of Southampton doi:10.5258/SOTON/D2067 [Dataset]

Mihai, Daniela and Hare, Jonathon (2021) Learning to Draw: Emergent Communication through Sketching. In Advances in Neural Information Processing Systems 34. vol. 34, Neural Information Processing Systems. 29 pp .

Mihai, Daniela and Hare, Jonathon (2021) Perceptions. The AI Art Gallery: NeurIPS Workshop on Machine Learning for Creativity and Design 2021.

Sabetsarvestani, Mohammadamin, Hare, Jonathon, Al-Hashimi, Bashir and Merrett, Geoff (2021) Similarity-aware CNN for efficient video recognition at the Edge. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems. (doi:10.1109/TCAD.2021.3136815).

Mihai, Andreea, Daniela and Hare, Jonathon (2021) Shared visual representations of drawing for communication: how do different biases affect human interpretability and intent? In Shared Visual Representations in Human and Machine Intelligence: 2021 NeurIPS Workshop. 10 pp .

Mihai, Andreea, Daniela and Hare, Jonathon (2021) Physically Embodied Deep Image Optimisation. 5th Workshop on Machine Learning for Creativity and Design (ML4CD 2021) of the Neural Information<br/>Processing Systems (NeurIPS), Virtual. 4 pp .

Bi, Jia, Hare, Jonathon and Merrett, Geoff (2021) GhostShiftAddNet: More Features from Energy-Efficient Operations. In The 32nd British Machine Vision Conference 2021.

Sadiq, Sulaiman, Hare, Jonathon, Maji, Partha, Craske, Simon and Merrett, Geoff (2022) TinyOps: ImageNet Scale Deep Learning on Microcontrollers. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2020). (In Press)

Contact

Share this profile FacebookTwitterWeibo