Home CV Publications Experience Teaching Awards

Xin (Eric) Wang

Ph.D. candidate

UC Santa Barbara,
CA 93106, USA

Email: xwang [at] cs [dot] ucsb [dot] edu


I am a fourth-year PhD candidate majoring in computer science at UCSB. Currently I am working with Prof. William Yang Wang and Prof. Yuan-Fang Wang. Prior to UCSB, I received the B.S. degree of computer science from Zhejiang University in July 2015.

My research interests lie in natural language processing, computer vision, and machine learning. More specifically,


[11/2018] Will serve as a PC member for NAACL 2019.
[10/2018] Our paper on zero-shot video captioning is accepted to AAAI 2019.
[09/2018] Will serve as a reviewer for CVPR 2019.
[08/2018] Will serve as a PC member for AAAI 2019.
[08/2018] Our paper on cross-lingual neural beleif tracking is accepted to EMNLP 2018.
[07/2018] Our paper "Look Before You Leap" is accepted to ECCV 2018.
[07/2018] Our paper on activity detection in untrimmed videos is accepted to BMVC 2018 as an oral paper.
[06/25/2018] Start my internship at Microsoft Research AI.
[05/2018]   Will serve as a PC member for EMNLP 2018.
[05/2018]   Our paper on Adversarial REward Learning (AREL) is accepted to ACL 2018 as a long oral paper.
[04/05/2018]   Passed my Major Area Exam and advanced to PhD candidacy. Thanks to my committee: Prof. William Wang (Co-Chair), Prof. Yuan-Fang Wang (Co-Chair), Prof. Matthew Turk, and Prof. Xifeng Yan.
[03/2018]   Our lab recieves the Adobe Research Award for language and vision research. Thanks Adobe!
[03/2018]   Will serve as a PC member for SoCal NLP Symposium 2018.
[02/2018]   Our paper "Watch, Listen, and Describe" is accepted to NAACL-HLT 2018.
[02/2018]   Our paper "Video Captioning via Hierarchical Reinforcement Learning" is accepted to CVPR 2018.
[10/20/2017]   My Adobe mentor Geoff presented the work we did this summer ProjectClark at Adobe MAX last night.

[06/2017]   Start the summer internship at Adobe Research.
[04/2017]   Check out our fantastic app Artistic Eye!
[03/2017]   Our multimodal transfer paper is accepted to CVPR 2017.
[06/2016]   Intern at Adobe Research, San Francisco.

Publications & Projects


Learning to Compose Topic-Aware Mixture of Experts for Zero-Shot Video Captioning
Xin Wang, Jiawei Wu, Da Zhang, Yu Su, William Yang Wang
AAAI 2019

[arXiv] [Code] [bibtex]

Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation
Xin Wang*, Wenhan Xiong*, Hongmin Wang, William Yang Wang
ECCV 2018

[arXiv] [Code] [bibtex]

XL-NBT: A Cross-lingual Neural Belief Tracking Framework
Wenhu Chen, Jianshu Chen, Yu Su, Xin Wang, Dong Yu, Xifeng Yan, William Yang Wang
EMNLP 2018

[arXiv] [Code] [bibtex]

No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling
Xin Wang*, Wenhu Chen*, Yuan-Fang Wang, William Yang Wang
ACL 2018
Oral presentation

[arXiv] [Code] [Video] [Slides (pptx)] [Slides (pdf)] [bibtex]

S3D: Single Shot multi-Span Detector via Fully 3D Convolutional Network
Da Zhang, Xiyang Dai, Xin Wang, Yuan-Fang Wang
BMVC 2018
Oral presentation

[arXiv] [Code] [Video] [Slides] [bibtex]

Video Captioning via Hierarchical Reinforcement Learning
Xin Wang, Wenhu Chen, Jiawei Wu, Yuan-Fang Wang, William Yang Wang
CVPR 2018

[arXiv] [Paper] [Supp] [Dataset] [bibtex]

Watch, Listen, and Describe: Globally and Locally Aligned Cross-Modal Attentions for Video Captioning
Xin Wang, Yuan-Fang Wang, William Yang Wang

[arXiv] [Paper] [bibtex]

Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer
Xin Wang, Geoffrey Oxholm, Da Zhang, Yuan-Fang Wang
CVPR 2017

[arXiv] [Paper] [Supp] [Images] [Code (Third-Party)] [bibtex]


Deep Reinforcement Learning for Visual Object Tracking in Videos
Da Zhang, Hamid Maei, Xin Wang, Yuan-Fang Wang
arXiv 2017

[arXiv] [Paper] [bibtex]


ProjectCloak: Remove Unwanted Objects in Video
In collabration with Geoffrey Oxholm, Oliver Wang, Eli Shechtman, Mike Lukac
2017 MAX Sneak
2018 MAX Keynote

[Project] [Blog] [Video]

ArtisticEye: A Real-time Application for High-resolution Artistic Style Transfer
In collabration with Geoffrey Oxholm
Applied to the de Young Museum in San Francisco
Honored to present the product prototype to the Adobe CEO face to face

[Blog] [Video]

Professional Experience

Microsoft Research, Redmond, US

       Research Intern,   06. 2018 - 09. 2018

       Mentors: Lei Zhang, Asli Celikyilmaz, Qiuyuan Huang

Adobe Research, San Francisco, US

       Research Intern,   06. 2017 - 09. 2017

       Mentors: Geoffrey Oxholm, Oliver Wang, Eli Shechtman, Mike Lukac

Adobe Research, San Francisco, US

       Research Intern,   06. 2016 - 09. 2016

       Mentor: Geoffrey Oxholm

Exacloud Inc., Hangzhou, China

       Software Engineer Intern,   12. 2014 - 03. 2015

HCI, Graphics and Computer Vision Group, HKU

       Research Assistant,   07. 2014 - 09. 2014

       Advisor: Yizhou Yu


2018 Winter Guest Lecturer CS281b: Computer Vision and Image Analysis
2017 Winter Teaching Assistant CS190I: Introduction to Natual Language Processing
2016 Fall Teaching Assistant CS180: Computer Graphics
2016 Winter Teaching Assistant CS48: Computer Science Project
2015 Fall Teaching Assistant CS16: Problem Solving with C++


Outstanding Graduates, Zhejiang University, 2015
Excellent Bachelor Thesis, Zhejiang University, 2015
CCF Outstanding Student Award (only 100 in China per year), China Computer Federation (CCF), 2014
National Endeavor Scholarship, Ministry of Education, China, 2012 - 2014
First Prize Outstanding Student Scholarship, Zhejiang University, 2013 - 2015
Merit Student Award, Zhejiang University, 2013 - 2014
Student Leadership Award, Zhejiang University, 2013
Activity Achievement Scholarship, Zhejiang University, 2012


  • Program Committee Member / Reviewer: NAACL 2019, CVPR 2019, AAAI 2019,  EMNLP 2018,  SoCal NLP 2018