• Web Crawling and Monitoring: I work on different subtasks that crawling involves such as discovering new pages, acquiring newly discovered pages and recrawling known pages. I proposed a new query-driven crawling paradigm on this front.
  
  
• Search Advertising: Search engines advertise by showing ads on Web pages as well as by displaying ads next to search query results. I use the Multi-armed Bandit problem to study both these forms of advertising.
  
  
• Multi-armed Bandit problem: I develop and study new variants of the classical Bandit problem. These variants are motivated by real applications from databases and search engines.

Conference Publications

• Recrawl Scheduling Based on Information Longevity
  Chris Olston and Sandeep Pandey
  WWW 2008, 17th International World Wide Web Conference



• Crawl Ordering by Search Impact
  Sandeep Pandey and Chris Olston
  WSDM 2008, 1st International Conference on Web Search and Data Mining



• Multi-armed Bandit Problems with Dependent Arms     (PPT)
  Sandeep Pandey, Deepayan Chakrabarti and Deepak Agarwal
  ICML 2007, 24th International Conference on Machine Learning



• The Discoverability of the Web
  Anirban Dasgupta, Arpita Ghosh, Ravi Kumar, Chris Olston, Sandeep Pandey and Andrew Tomkins
  WWW 2007, 16th International World Wide Web Conference



• Bandits for Taxonomies: A Model-based Approach     (PPT)
  Sandeep Pandey, Deepak Agarwal, Deepayan Chakrabarti and Vanja Josifovski
  SDM 2007, SIAM International Conference on Data Mining



• Handling Advertisements of Unknown Quality in Search Advertising     (PPT)
  Sandeep Pandey and Chris Olston
  NIPS 2006, 20th Annual Conference on Neural Information Processing Systems



• Shuffling a Stacked Deck: The Case for Partially Randomized Ranking of Search Engine Results     (PPT)
  Sandeep Pandey, Sourashis Roy, Chris Olston, Junghoo Cho and Soumen Chakrabarti
  VLDB 2005, 31st International Conference on Very Large Data Bases



• User-Centric Web Crawling     (PPT)
  Sandeep Pandey and Chris Olston
  WWW 2005, 14th International World Wide Web Conference



• WIC: A General-Purpose Algorithm for Monitoring Web Information Sources     (PPT)
  Sandeep Pandey, Kedar Dhamdhere and Chris Olston
  VLDB 2004, 30th International Conference on Very Large Data Bases



• Monitoring the Dynamic Web to respond to Continuous Queries     (PPT)
  Sandeep Pandey, Krithi Ramamritham and Soumen Chakrabarti
  WWW2003, 12th International World Wide Web Conference

• Optimization Problems in Web Search Engines
  Theory Lunch, Stanford (Feb 2008)

• Using Bandit Models in Search Engines
  DB Seminar, CMU (Nov 2007)

• Crawl Ordering by Search Impact
  Yahoo! Research, Santa Clara (April 2007)

• Shuffling a Stacked Deck: The Case for Partially Randomized Ranking of Search Engine Results
  Yahoo! Research, Sunnyvale (June 2005)

• User-Centric Web Crawling
  Stanford (May 2005) and Yahoo! Research (April 2007)