MythTV guide

Permalink 06/20/07 05:13:07 pm, Categories: Development  

This entry is a placeholder for a comments related to a discussion about a TV Guide replacement for electronically delivered TV listings.

--Added 9:21 AM EDT, June 21, 2007

I have opened up a wiki page on this. I expect that if this becomes a full project, we'll quickly reevaluate our development tools, but, I think for incubation period, it's ok to run this off my server.

The Wiki Page is here

Comments, Pingbacks:

Comment from: patf [Member] Email · http://patf.net
I have created this entry to allow us to have a discussion about a MythTV listing replacement.

I had hoped to install MythTV this summer, but no listings could be a deal breaker. I hope we can form some solution to keep this from happening.
PermalinkPermalink 06/20/07 @ 17:20
Comment from: AeroIllini [Visitor] Email
I like the idea of a centralized system to parse screen scrapings and serve nice neat XML files to whoever requests them, including MythTV installations. The full HTML download and scrape algorithm would only have to be run once in a while, saving the bandwidth/processing of having everyone downloading the same full HTML file and parsing it locally every time. Additionally, patches to correct scraping errors only have to be applied to a single server.

Here are some random musings about problems we might encounter, and possible solutions:
  • bandwidth requirements: datacenters and big fat fiber lines are not cheap, and don't scale too well to completely free web services. I see two ways to mitigate these issues: 1) we can include hashes of each of the XML files, and instruct clients to compare hashes before downloading a new XML file (local caching, basically), which would reduce overall bandwidth usage, and 2) we can have a central server scraping the screen, generating XML files, and then "load balancing" requests out to volunteer servers who keep caches of the XML files and the hashes. If a user of the service has the bandwidth, and would like to contribute, they could install a small app and also become a cache server.
  • Litigation: This could be a big issue. I'm not sure what the laws say surrounding the issue of screen scraping, but I imagine the scraping itself falls under fair use just like recording the radio to tape. As for the listings themselves, they may be copyrighted, and the companies providing them (Yahoo, Comcast, whoever) probably won't hesitate to file suit to get us to stop scraping (we'd be affecting ad revenue, after all). I don't really have a solution for this, but it's definitely worth discussion.

I am willing to help out with this project, including hosting, programming, designing, evangelizing, whatever. I'm in the middle of building my own embedded MythTV system right now, and I would love to contribute. This seems like a good way to do that.
PermalinkPermalink 06/20/07 @ 19:33
Comment from: One word... [Visitor] Email
BitTorrent.

Scalability - solved.
Litigation - partially avoided.
PermalinkPermalink 06/20/07 @ 19:55
Comment from: Bobby [Visitor] Email
I am interested in helping out with the project. I have setup a MythTV box in the past and know how important it is to have reliable TV listings. I have no programming skills, but can admin Windows/Linux machines fairly well. I have a dedicated fiber connection and might be able to provide a dedicated server if the situation seems right. Please let me know if I can help.
PermalinkPermalink 06/21/07 @ 01:36
Comment from: Eric [Visitor] Email
I'll help out with this in any way. Aero, I figure a torrent server can stay in seed-only mode and do the scraping and shaping. The client can have a change-aware torrent client behind it and a variety of widget front ends to start off with.
PermalinkPermalink 07/11/07 @ 02:22
Comment from: Keith Barrett [Visitor] Email
This is an idea that I proposed on the MythDev list and believe it's the best way to proceed. Scripts could run from different systems and update a central database. This database would be what all the MythTV users download; specifying what portions they wanted.

The scripts should scan multiple guide sites, removing dependence on any single one, plus suppport manual guide info entry from the community to fill in any gaps and further distance the efforts from perceived IP and copyright problems.

The main concerns about all this were the dependency on a single server for the MythTV users (which COULD be eliminated by using P2P networks to grab files based on date ranges).

I REALLY believe this is the way to go. A community site where every channel in the world, as well as internet channels and pod casts, are all in one site database for browsing and fetching.


PermalinkPermalink 08/09/07 @ 17:20
Comment from: patf [Member] Email · http://patf.net
Does http://schedulesdirect.org/ negate the need for us to develop this?

PermalinkPermalink 08/10/07 @ 16:54
Comment from: DD [Visitor] Email
Not really, since this is based on someone else's feed and registrations are closed.

I'm a windows developer with in-depth scraping experience, willing to help.
PermalinkPermalink 08/23/07 @ 15:55
Comment from: server racks [Visitor] Email · http://www.dsiwholesalers.com
What about myth tv? I am trying to get it installed and hope it has a guide too.
PermalinkPermalink 07/08/09 @ 14:21

Leave a comment:

Your email address will not be displayed on this site.
Your URL will be displayed.

Allowed XHTML tags: <p, ul, ol, li, dl, dt, dd, address, blockquote, ins, del, span, bdo, br, em, strong, dfn, code, samp, kdb, var, cite, abbr, acronym, q, sub, sup, tt, i, b, big, small>
(Line breaks become <br />)
(Set cookies for name, email and url)
(Allow users to contact you through a message form (your email will NOT be displayed.))
This is a captcha-picture. It is used to prevent mass-access by robots.

Please enter the characters from the image above. (case insensitive)

The Farrellel Universe

A weblog focusing on software development, computer science, mathematics, music, and probably lacking focus.

September 2010
Sun Mon Tue Wed Thu Fri Sat
 << <   > >>
      1 2 3 4
5 6 7 8 9 10 11
12 13 14 15 16 17 18
19 20 21 22 23 24 25
26 27 28 29 30    

Search

Categories

XML Feeds

What is this?

powered by b2evolution free blog software