Brief Bio

I am a researcher at Microsoft AI Perception & Mixed-Reality.

I received my Ph.D. degree from the Department of Computer Science, University of Rochester. My advisor is Prof. Jiebo Luo.

View Quanzeng You's profile on LinkedIn

Research Interests

  • Computer Vision
  • Social Multimedia: Understanding of UGC
  • Media Understanding: High-level visual content understanding
  • Data Mining: Data mining on social networks
  • Experience

    1. Research Intern (2016.6-2016.8), Facebook, Menlo Park, CA.
      Project: Understanding cultural dynamics in Facebook photos. Mentor: Jungseock Joo
    2. Deep Learning Research Intern (2015.6-2015.9), Adobe Research, San Jose, CA.
      Project: Image Captioning. Mentor: Hailin Jin, Zhaowen Wang and Chen Fang.
    3. Research Intern (2014.5-2014.8), PARC East, Rochester, NY.
      Project: User Profiling. Mentor: Sumit Bhatia and Tong Sun.
    4. Research Intern (2013.6-2014.8), Microsoft Research, Redmond, WA.
      Project: Using Geo-tagged Tweets for Navigation. Mentor: John Krumm.
    5. Software Engineering Intern (2012.3-2012.7), Baidu, Beijing.
      Project: Personalized Ad. Mentor: Yueting Li.

    Publications

    View My Google Scholar


    Computer Vision and Media Understanding

    1. Tianlang Chen, Zhongping Zhang, Quanzeng You, Chen Fang, Zhaowen Wang, Hailin Jin, Jiebo Luo, “Factual or Emotional: Stylized Image Captioning with Adaptive Learning and Attention,” European Conference on Computer Vision (ECCV), Munich, Germany, September 2018.
    2. Yuxiao Chen*, Jianbo Yuan*, Quanzeng You, Jiebo Luo, "Twitter Sentiment Analysis via Bi-sense Emoji Embedding and Attention-based LSTM," ACM Multimedia Conference, Seoul, Korea, 2018.
    3. Quanzeng You, Hao Jiang. Action4D: Real-time Action Recognition in the Crowd and Clutter. 2018.
    4. Quanzeng You, Zhengyou Zhang, Jiebo Luo. "End-to-end Convolutional Semantic Embeddings", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, June 2018.
    5. Honglin Zheng, Tianlang Chen, Quanzeng You, Jiebo Luo, “When Saliency Meets Sentiment: Understanding How Image Content Invokes Emotion and Sentiment,” International Conference on Image Processing (ICIP), Beijing, China, September 2017
    6. Quanzeng You, Hailin Jin and Jiebo Luo. "Visual Sentiment Analysis by Attending on Local Image Regions", Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17), San Francisco, CA. 2017.
    7. Yang Cong, Ji Liu, Gan Sun, Quanzeng You, Yuncheng Li, and Jiebo Luo, "Adaptive Greedy Dictionary Selection for Web Media Summarization," in IEEE Transactions on Image Processing, vol.PP, no.99, pp.1-1. doi: 10.1109/TIP.2016.2619260
    8. Quanzeng You. "Sentiment and Emotion Analysis for Social Multimedia: Methodologies and Applications", ACM Multimedia Conference (ACM MM), Doctoral Symposium, Amsterdam, The Netherlands, October 2016.
    9. Quanzeng You, Liangliang Cao, Hailin Jin, Jiebo Luo, "Robust Visual-Textual Sentiment Analysis: When Attention meets Tree-structured Recursive Neural Networks", ACM Multimedia Conference (ACM MM), Amsterdam, The Netherlands, October 2016.
    10. Quanzeng You, Hailin Jin, Zhaowen Wang, Chen Fang, Jiebo Luo, "Image Captioning with Semantic Attention", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, June 2016. (Spotlight)
    11. Quanzeng You, Hailin Jin, Jianchao Yang, Jiebo Luo, "Building a Large Scale Dataset for Image Emotion Recognition: The Fine Print and The Benchmark," AAAI, 2016. [Project Page]
    12. Quanzeng You, Hailin Jin, Jianchao Yang, Jiebo Luo, "Cross-modality Consistent Regression for Joint Visual-Textual Sentiment Analysis," ACM International Conference on Web Search and Data Ming (WSDM), February 2016.
    13. Quanzeng You, Liangliang Cao, Yang Cong, Xianchao Zhang and Jiebo Luo. A Multifaceted Approach to Social Multimedia-based Prediction of Elections. IEEE Transactions on Multimedia (TMM), 2015.
    14. Quanzeng You, Jiebo Luo, Hailin Jin and Jianchao Yang. Joint Visual-Textual Sentiment Analysis with Deep Neural Networks, ACM Multimedia (short), 2015. [PDF]
    15. Quanzeng You, Jiebo Luo, Hailin Jin and Jianchao Yang. Robust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep Networks, AAAI, 2015.[PDF] [Project Page]

    Human Computer Interaction

    1. Tianran Hu, Anbang Xu, Zhe Liu, Quanzeng You, Yufan Guo, Vibha Sinha, Jiebo Luo, Rama Akkiraju. "Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media", The ACM CHI Conference on Human Factors in Computing Systems (CHI), Montreal, Canada, April 2018.
    2. Quanzeng You, Jianbo Yuan, Jiaqi Wang, Philip Guo, Jiebo Luo. Snap n' Shop: Visual Search-Based Mobile Shopping Made a Breeze by Machine and Crowd Intelligence, IEEE International Conference on Semantic Computing, 2015.[PDF]

    Social Media Data Mining

    1. Fenglong Ma, Jing Gao, Qiuling Suo, Quanzeng You, Jing Zhou and Aidong Zhang. "Risk Prediction on Electronic Health Records with Prior Medical Knowledge", Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2018), London, United Kingdom, August 2018.
    2. Fenglong Ma, Radha Chitta, Jing Zhou, Quanzeng You, Tong Sun, Jing Gao. Dipole: Diagnosis Prediction in Healthcare via Attention-based Bidirectional Recurrent Neural Networks. Proceedings of the 23th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2017), Halifax, Nova Scotia - Canada, August 2017.
    3. Quanzeng You, Liangliang Cao, Jiebo Luo, “Image Based Appraisal of Real Estate Properties,” IEEE Transactions on. Multimedia (TMM), in press. 2017.
    4. Quanzeng You, Dario Garcia Garcia, Manohar Paluri, Jiebo Luo, Jungseock Joo. Cultural Dynamics and Trends in Facebook Photographs, AAAI International Conference on Web and Social Media (ICWSM), 2017.
    5. Xianchao Zhang, Linlin Zong, Quanzeng You, Xing Yong. Sampling for Nyström Extension based Spectral Clustering: Incremental Perspective and Novel Analysis. IEEE Transactions on Knowledge DIscovery from Data (TKDD), 2016.
    6. Quanzeng You, Sumit Bhatia, Jiebo Luo. A Picture Tells a Thousand Words--About You! User Interest Profiling from User Generated Visual Content, Signal Processing, 2015.
    7. Danning Zheng, Tianran Hu, Quanzeng You, and Jiebo Luo, Towards Lifestyle Understanding: Predicting Home and Vacation Locations from User's Online Photo Collections, AAAI International Conference on Weblogs and Social Media (ICWSM), May 2015. [PDF]
    8. Danning Zheng, Tianran Hu, Quanzeng You, Henry Kautz, and Jiebo Luo. Inferring Home Location from User's Photo Collections based on Visual Content and Mobility Patterns,ACM Multimedia Conference, Workshop on Geotagging in Multimedia (GeoMM), November 2014.
    9. Quanzeng You, Sumit Bhatia, Tong Sun, Jiebo Luo. The eyes of the beholder: Gender prediction using images posted in online social networks, IEEE International Conference on Data Mining, Workshop on Social Multimedia Data Mining, 2014.[PDF]
    10. Quanzeng You, John Krumm. Transit tomography using probabilistic time geography: planning routes without a road map, Journal of Location Based Services, 3(97):1-18, 2014. [PDF][PDF Proof Version]
    11. Junhuan Zhu, QuanzengYou, Jiebo Luo and John R. Smith. Towards Understanding the Effectiveness of Election Related Images in Social Media, IEEE International Conference on Data Mining (ICDM), Workshop on Domain-driven Data Mining, December 2013. [PDF]
    12. Jianbo Yuan, Quanzeng You, and Jiebo Luo, Are There Cultural Differences in Event Driven Information Propagation Over Social Media? ACM Multimedia Conference, International Workshop on Socially-Aware Multimedia (IWSAM), October 2013. [PDF]
    13. Quanzeng You and Jiebo Luo, Towards Social Imagematics: Sentiment Analysis in Social Multimedia, ACM SIGKDD, Workshop on Multimedia Data Mining, August 2013. [PDF]
    14. Jianbo Yuan, Quanzeng You, Sean McDonough, and Jiebo Luo, Sentribute: Image Sentiment Analysis from a Mid-level Perspetive, ACM SIGKDD, Workshop on Issues of Sentiment Discovery and Opinion Mining (WISDOM), August 2013. [PDF]
    15. Xianchao Zhang, Quanzeng You. Clusterability Analysis and Incremental Sampling for Nystrom Extension Based Spectral Clustering. ICDM, 942–951, 2011. [PDF]
    16. Xianchao Zhang,Quanzeng You. An Improved Spectral Clustering Based on Random Walk. Friontiers of Computer Science in China, vol. 5, no. 3, pp. 268-278, 2011. [PDF]

    Pixels and Patches

    From Prof. Jiebo Luo

    1. TED: Body Language Shapes Who You Are