SwissCenter - Re: ofdb Parser - need some help


SwissCenter

Main Menu

No account yet? Create one

Home

Forums

SwissCenter Forums

home | post reply | threaded view | help

Boardwalk :: Forum List

SwissCenter

Suggestions + Enhancements

KMan
User

Posts: 52

ofdb Parser - need some help - 2008/09/23 08:36 Hi!

this is you favourite php noob again

i have a problem with the ofdb parser, it misses some titles (e.g. Starship Troopers Marauder) which are defenatly in the database.

I guess this is a problem caused by google cause it hasnt indexed this page yet, but i am not sure of that.

BUT

why is google used at all ????
wouldnt it be more logical to query ofdb directly ????

i know i can do a search on ofdb like this:

Code:


 http://www.ofdb.de/view.php?page=suchergebnis&Kat=Titel&SText=starship%20troopers%20marauder

but as usual i dont have the slightest idea how to make any use of this information within the ofdb parser.

Can somebody enlighten me why google is necessary or if it is not, can take a look if it is possible to improve the parser with the knowledge from above ?

Kind regards

KMan Player : Pinnacle ShowCenter 250HD (wired)
Server : XP Pro SP2+ (Simese 1.45, SwissCenter current SVN)
Spec : Intel Pentium D830 (DualCore) 3GHz, 2GB RAM

| | The administrator has disabled public write access.

upD8R

User

Posts: 148

Re: ofdb Parser - need some help - 2008/09/23 09:04 I discovered the same, with the same movie, BTW.

I can't help you with the parser but I was getting the information about director and actors from a IMDB query. Afterwards I copied the German synopsis manually into the details.

I can live with this workaround as the information is now stored in the XML and won't get lost in case you need to reinstall ... 2x SC200 (wired), SwissCenter latest SVN, Simese 1.40
http://www.knecht-ruprecht.info

| | The administrator has disabled public write access.

Pernod

Admin

Posts: 1504

Re: ofdb Parser - need some help - 2008/09/23 09:06 why is google used at all ????
wouldnt it be more logical to query ofdb directly ????
Because the ofdb search doesn't reliably return the page that contains the details that we want. More often than not it will return a page containing a review of the film rather than it's details.

Using Google allows us to specify exactly what we want to find in the required page title. This was found to produce the most consistant results when it was developed and tested by the users. Player : Netgear EVA700 & Popcorn A-100 (081224)
Server : Vista SP1 Home Premium (Simese 2.06, SwissCenter current SVN)
Spec : Intel C2Q Q6600, 2GB RAM, 2Tb storage.

| | The administrator has disabled public write access.

KMan
User

Posts: 52

Re: ofdb Parser - need some help - 2008/09/23 09:22 Pernod wrote:
why is google used at all ????
wouldnt it be more logical to query ofdb directly ????
Because the ofdb search doesn't reliably return the page that contains the details that we want. More often than not it will return a page containing a review of the film rather than it's details.

Using Google allows us to specify exactly what we want to find in the required page title. This was found to produce the most consistant results when it was developed and tested by the users.

Thanks for the info Nigel,

BUT the search result page contains
Titel: which indicates it found a title and the url still contains /film/ which if i read the parser correctly is searched for anyways.

wouldnt looking after the titel for urls with /film/ in them, have the same effect as parsing the google result like that ????

when i query the mentioned movie i always get info on the 1st starship troopers movie, which is quite annoying, besides this seems also the reason for the false synopsis on movies which dont have any on ofdb ?!?

btw fyi,
i now tried several movies querying like mentioned, all returned the film page, none returned a review page ??? Maybe ofdb got that fixed ? Player : Pinnacle ShowCenter 250HD (wired)
Server : XP Pro SP2+ (Simese 1.45, SwissCenter current SVN)
Spec : Intel Pentium D830 (DualCore) 3GHz, 2GB RAM

| | The administrator has disabled public write access.

KMan
User

Posts: 52

Re: ofdb Parser - need some help - 2008/09/23 10:16 o.k. - here is the quick 'n' dirty solution of mine:

in the ofdbparser i edited the folowing:
old:

Code:


     $search_url   = 'http://www.google.de/search?q=#####+site%3Aofdb.de';

new:

Code:


     $search_url   = 'http://www.google.de/search?q=allintitle%3A#####+-review+site%3Aofdb.de&filter=0';

this may but most likely will not have side effects that i am currently not aware of, but at least this solved all issues which i had with titles from my db.

Use at your own risk

oh, for those who care, it narrows googles results by excluding all pages that have review in their title and only show matches that have all words from the title (from your db) in the page title aswell. Additionally it avoids that google filters matches because of simular content.

Hope this helps,

@Pernod - Something you can live with ?

Kind regards

KMan Player : Pinnacle ShowCenter 250HD (wired)
Server : XP Pro SP2+ (Simese 1.45, SwissCenter current SVN)
Spec : Intel Pentium D830 (DualCore) 3GHz, 2GB RAM

| | The administrator has disabled public write access.

Boardwalk :: Forum List SwissCenter Suggestions + Enhancements

Simpleboard Forum Component 1.1.0 Stable
Two Shoes Mambo Factory

Screenshots

www.flickr.com

This is a Flickr badge showing public photos from swisscenter. Make your own badge here.

Mambo is Free Software released under the GNU/GPL License.