Abstract: This paper explores efficient ways to implement various
media-updating features like news aggregation, video conversion,
and bulk email handling. All of these jobs share the property
that they are periodic in nature, and they all benefit from being
handled in a distributed fashion. The data for these jobs also often
comes from a social or collaborative source. We isolate the class of
periodic, one round map reduce jobs as a useful setting to describe
and handle media updating tasks. As such tasks are simpler than
general map reduce jobs, programming them in a general map
reduce platform could easily become tedious. This paper presents
a MediaUpdater module of the Yioop Open Source Search Engine
Web Portal designed to handle such jobs via an extension of a
PHP class. We describe how to implement various media-updating
tasks in our system as well as experiments carried out using these
implementations on an Amazon Web Services cluster.
Abstract: An online advertisement system and its implementation
for the Yioop open source search engine are presented. This system
supports both selling advertisements and displaying them within
search results. The selling of advertisements is done using a system
to auction off daily impressions for keyword searches. This is an
open, ascending price auction system in which all accepted bids will
receive a fraction of the auctioned day’s impressions. New bids in
our system are required to be at least one half of the sum of all
previous bids ensuring the number of accepted bids is logarithmic
in the total ad spend on a keyword for a day. The mechanics of
creating an advertisement, attaching keywords to it, and adding it
to an advertisement inventory are described. The algorithm used to
go from accepted bids for a keyword to which ads are displayed at
search time is also presented. We discuss properties of our system
and compare it to existing auction systems and systems for selling
online advertisements.