WSDM Cup Ranker Challenge

WSDM Cup 2016 – Entity Ranking Challenge Workshop

Date: Monday, February 22, 2016 (2:00pm – 5:30pm)
Location: Room 4, Mission Bay Conference Center (http://www.acc-missionbayconferencecenter.com), San Francisco, CA
Registration: This workshop is currently full.

Organized in conjunction with WSDM 2016, the workshop aims to bring together researchers in the area of data mining and large heterogeneous networks. The goal of 2016 WSDM Cup challenge was to assess the query-independent importance (static-rank values) of scholarly articles, using data from the Microsoft Academic Graph--a large heterogeneous graph comprised of publications, authors, venues, organizations, and fields of study. Phase 1 of the challenge ran from August – November 2015, and participant submissions were evaluated against a test set of expert human judgements. The top eight teams from Phase 1 have been invited to present their approaches at this workshop, and to participate in Phase 2 which will be completed prior to the WSDM 2016 conference. During Phase 2, the top-eight teams’ datasets have been applied as public facing flights in Bing search results and will power the ranker used by Bing for academic queries. The results of the Phase 2 evaluation will also be discussed at this workshop.

Schedule:

Time Topic Speakers
2:00 - 2:10 Welcome Alex Wade – Microsoft Research
2:10 - 3:30

Ensemble of Ranking Strategies for Static Rank Prediction in a Large Heterogeneous Graph.



Simplified Relative Citation Ratio for Static Paper Ranking


Simple Yet Effective Methods for Large-Scale Scholarly Publication Ranking

Ensemble Enabled Weighted PageRank

Shu-Kai Chang – National Taiwan University
Chun-Wei Chen – National Taiwan University
Huan-Yuan Chen – National Taiwan University

Sabir Ribas – Universidade Federal de Minas Gerais, Brazil

Drahomira Herrmannova – Open University, UK

Dongsheng Luo – Beihang University, China
Renjun Hu – Beihang University, China

3:30 - 4:00 Break
4:00 - 5:00

Static Ranking of Scholarly Papers using Article-Level Eignefactor (ALEF)

Time-Aware Weighted PageRank for Paper Ranking in Academic Graphs

An Efficient Solution to Reinforce Paper Ranking using Author/Venue/Citation Information – The Winner’s Solution

Jevin West – University of Washington
Ian Wesley-Smith – University of Washington

Kuan Hou Chan – National Taiwan University
Sz-Han Yu – National Taiwan University

Ming-Han Feng – National Taiwan University

5:00 - 5:30 Panel Discussion

Kuansan Wang – Microsoft Research
Antonio Gulli – Elsevier B.V.
Yizhou Sun – Northeastern University

5:30 Conclusion

Accepted Papers

The accepted papers can be accessed at: https://doc.co/7HPGvd

Cite this workshop as:
Wade, A. D., Wang, K., Sun, Y., Gulli, A. 2016. WSDM Cup 2016 – Entity Ranking Challenge. Proceedings of the 9th ACM Conference on Web Search and Data Mining, San Francisco, CA.

Organizers:

  • Alex Wade – Microsoft Research (workshop contact – awade [at] microsoft [dot] com)
  • Kuansan Wang – Microsoft Research
  • Antonio Gulli – Elsevier B.V.
  • Yizhou Sun – Northeastern University