Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
avgjoemomma
User
Posts: 105
Re: IMDb SmartSearch parser released - 2009/03/16 19:58Hi Utsi,
I updated to the new version but it seems it is no longer using the date in the movie name to check IMDB against. For example, I have The Day The Earth Stood Still (1951).avi but after parsing it returns the new movie Player: Popcorn Hour A-110 Router: Linksys-Cisco WRT54GL (DD-WRT) (TCP Vegas enabled) SC server: QNAP TS-109 II Lighttpd v1.4.23-1 PHP v5.2.11 MySQL v5.0.27-log NAS Server: QNAP TS-109 II
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/03/17 02:38I can't really see how that could have happened. All I did was that I pasted in a couple of lines from the supported parser, I did not change the program flow. But I will look into it when I get home from work.Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/03/17 17:22I've checked it out, and yes, it doesn't work. But the problem, however, isn't with the parser, it's with www.imdb.com. Try searching for "The Day the Earth Stood Still (1951)" on their site, it doesn't care about the year at all. Try "Dracula (1992)" or "Dracula (1931)" and it gives you direct hits for the right movie. Why IMDb have decided to do this with The Day the Earth stood still is beyond me.
Maybe something could be worked out to compensate for IMDb's shortcomings, but it would mean some serious digging...Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
avgjoemomma
User
Posts: 105
Re: IMDb SmartSearch parser released - 2009/03/17 19:30Ah, you have to love IMDB and it's trappings. Thanks so much for looking into the issue. At this point, the best option is probably to have the ability to add the ID's for Movies, TV series, etc as used by IMDB, TheTVDB into the detail section and use that to help with lookups. Player: Popcorn Hour A-110 Router: Linksys-Cisco WRT54GL (DD-WRT) (TCP Vegas enabled) SC server: QNAP TS-109 II Lighttpd v1.4.23-1 PHP v5.2.11 MySQL v5.0.27-log NAS Server: QNAP TS-109 II
| | The administrator has disabled public write access.
Pernod
Admin
Posts: 2783
Re: IMDb SmartSearch parser released - 2009/03/17 21:04With the official parser (latest development) searching for 'The Day the Earth Stood Still (1951)' will return the correct details.Players : Netgear EVA700 | Popcorn A-100 (091202) | Popcorn A-200 (100208) Webserver : Simese v2.6.4 | Apache 2.2.14 | PHP v5.2.12 | MySQL v5.1.32 Server : Windows 7 Home Premium 64bit Spec : Intel C2Q Q6600 - 4GB RAM - 3TB HDD AV : Pioneer VSX-915 | Samsung LE40C650
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/03/18 07:00That is good news and it means that you should be able to get the same results with this parser too, assuming that the logic in SwissCenter that picks the best result has been improved. I will have a look after work. If not, I'll have to do some small adjustments in the code.Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Pernod
Admin
Posts: 2783
Re: IMDb SmartSearch parser released - 2009/03/18 07:39assuming that the logic in SwissCenter that picks the best result has been improved No, it's the parser that's been improved. If the movie title being searched for contains a year in brackets then it will try to match it with the year from IMDB.Players : Netgear EVA700 | Popcorn A-100 (091202) | Popcorn A-200 (100208) Webserver : Simese v2.6.4 | Apache 2.2.14 | PHP v5.2.12 | MySQL v5.1.32 Server : Windows 7 Home Premium 64bit Spec : Intel C2Q Q6600 - 4GB RAM - 3TB HDD AV : Pioneer VSX-915 | Samsung LE40C650
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/03/18 17:25Hmm.. I created a file and named it 'The Day the Earth Stood Still (1951).avi' but the parser still returned details for the seemingly crappy remake from 2008. It doesn't seem to work.
I haven't had the time to look into the code as I've got a lot to do at work. If the parser thinks that it will get a direct hit based on the title+<space>+(+<year>+) it's out of luck. If you look at the page returned from imdb when searching for 'The Day the Earth Stood Still (1951)' you'll see that the 2008 version is still the #1 hit.
We should parse that page and look for the link to the left of the submitted year string, I think. Then we could remove irrelevant hits like video games (VG) as well.Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/03/20 04:14I've found a quick and dirty way to get the desired result from imdb if the movie name is 100% correct and we have the year. This will solve the problem with 'The Day the Earth Stood Still (1951)'. My code, however, is starting to look like crap. It's basically a big if/else monster and I will have to do some refactoring eventually, but I should probably learn more about php first. Will upload a new version soon.
I'm sorry, Squark, I can't help you. But you are free to copy anything from my parser and customize the parser you're currently using.Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Pernod
Admin
Posts: 2783
Re: IMDb SmartSearch parser released - 2009/03/20 06:55Did you look at the code of the official parser? If you provide a year in the movie title then it is used when performing the best_match against the results returned from IMDB.Players : Netgear EVA700 | Popcorn A-100 (091202) | Popcorn A-200 (100208) Webserver : Simese v2.6.4 | Apache 2.2.14 | PHP v5.2.12 | MySQL v5.1.32 Server : Windows 7 Home Premium 64bit Spec : Intel C2Q Q6600 - 4GB RAM - 3TB HDD AV : Pioneer VSX-915 | Samsung LE40C650
| | The administrator has disabled public write access.
Squark
User
Posts: 20
Re: IMDb SmartSearch parser released - 2009/03/20 07:21I did it =P Here is the modified ofdb parser...
I used your code from the imdb smart parser to modifie the official www.ofdb.de parser. It works for me, but I will give no guarantie for the code. I'm no php dev, so use it on your own risk!^^
Code modifications are commented with /* begin */ [...] /* end */
I'll give NO support on this parser because I only copy pasted code lines between the two parsers and have basicly no idea what they're god for!^^
Attention!! This parser will maybe change also the title of Movies to the official title submitted by ofdb! (Word reordering like 'Simpsons, The' should not be applied)
| | The administrator has disabled public write access.
Squark
User
Posts: 20
Re: IMDb SmartSearch parser released - 2009/03/20 10:41Here is the file. Couldn't upload it to a edited post...
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/03/20 14:53Squark, that is great, I'm glad you could use it! I think it would be better if you started a new thread, that'll make it much easier to find it for other ofdb-users and will keep things more tidy here
Pernod, I did not have a very long look at the code, but it seemed to search for the string "</a> (year)" if it existed. But I couldn't get it to do the job, did you create the file yourself to test it or is it just theoretically working? I can give it another try, but I have my doubs. By the way, how to you debug your code? Is there any way to run it in debug mode with breakpointc etc or is send_to_log the only way?Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Pernod
Admin
Posts: 2783
Re: IMDb SmartSearch parser released - 2009/03/20 19:42Pernod, I did not have a very long look at the code, but it seemed to search for the string "</a> (year)" if it existed. But I couldn't get it to do the job, did you create the file yourself to test it or is it just theoretically working? This is developed and tested by myself and works perfectly. The important piece of code is:
Code:
// If the title contains a year in brackets ie.(1978) then adjust the returned page to include year
in search
if (preg_match("/\((\d+)\)/",$details[0]["TITLE"],$title_year) != 0)
{
$html = preg_replace('/<\/a>\s+\((\d\d\d\d).*\)/Ui',' ($1)</a>',$html);
$title .= ' '.$title_year[0];
}
If the user provides a year in the movie title then the parser modifies the returned page from IMDB to include the year in the link that is used in the function best_match to return the correct details.Players : Netgear EVA700 | Popcorn A-100 (091202) | Popcorn A-200 (100208) Webserver : Simese v2.6.4 | Apache 2.2.14 | PHP v5.2.12 | MySQL v5.1.32 Server : Windows 7 Home Premium 64bit Spec : Intel C2Q Q6600 - 4GB RAM - 3TB HDD AV : Pioneer VSX-915 | Samsung LE40C650
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/03/21 06:22Ok, I did some "debugging" now, and I had forgotten that strings like (1951) are removed from the title when the title is just the file name (first time search). This means that it will not work unless the user _manually_ enters "(1951)" in the title in the config utility.
I've been able to work around this by getting the year from the file- or folder name instead, so this will work great in the SmartSearch parser.Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/03/22 08:12-Added Pernod's regular expression magic to alter html if year is present in title. This resolves the problem with IMDb not taking year into account if there are more popular remakes of a movie.
-Added functionality to get the title from IMDb as titles may contain symbols that are illegal in file names, like ':' or '!' etc. The drawback is that in some cases you'll get the original movie title instead of the English one.
Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/06/12 08:24I've noticed a small problem with the parser when using popcornhour: If the movie name contains an apostrophe, like in "I'm not there" or "Schindler's list", popcornhour will only show the text before the apostrophe. The reason is that imdb.com uses html escape characters in hex, not decimal. Regular browsers have no problem with this, popcornhour has.
What we need is some code that can do this: "I&_#_x_2_7_;m Not There." -----> "I&_#_3_9_;m Not There."
(remove the underscores)
Converting hex to decimal is the easy part. My problem is that I don't know regular expressions. I could of course do some messy substring operations, but I'd like to find a more elegant solution.
Any ideas, Pernod or Rob?Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Pernod
Admin
Posts: 2783
Re: IMDb SmartSearch parser released - 2009/06/12 08:42Does this only affect your parser, have you compared to the latest official one?
I use html_entity_decode($html, ENT_QUOTES); to remove the entities.Players : Netgear EVA700 | Popcorn A-100 (091202) | Popcorn A-200 (100208) Webserver : Simese v2.6.4 | Apache 2.2.14 | PHP v5.2.12 | MySQL v5.1.32 Server : Windows 7 Home Premium 64bit Spec : Intel C2Q Q6600 - 4GB RAM - 3TB HDD AV : Pioneer VSX-915 | Samsung LE40C650
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/06/12 08:56No, I haven't looked into your latest parser yet. The last time I did, it didn't fetch the title from imdb. And it only affects my parser, yes.
I did some brief tests with the function you mentioned, but without the ENT_QUOTES parameter. It didn't work with hex escape characters. Will certainly check it out when I get home. Thanks.Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/06/20 16:09Pernod: It didn't work, I don't know if it's because of the hex escape characters or if it's something else.
Anyway, I made a small function that replaces hex escape characters with decimal escape characters.
Sorry about the delay but my employer gave me a new laptop, so I had to give my old one (with the SC installation) back. The problem with the new one is that it has Windows Vista installed and has an encrypted hard drive. I haven't figured out a way to make a working WMVare image of it yet so that I can delete Vista and install Linux. So now I'm back to my old home computer
I don't know if this fix will help others than the popcornhour users, but if your movie titles appear as "Schindler" instead of "Schindler's List" and so on, I think it will.
Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/08/06 14:57Imdb changed their layout, so the parser wouldn't return the actors when direct hit on title. This has now been fixed.
Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/08/07 15:43Ooops, a small bug in the code caused the parser to get the thumbnail of the movie cover rather than the cover. Fixed.
Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
avgjoemomma
User
Posts: 105
Re: IMDb SmartSearch parser released - 2009/08/07 15:48Thanks again, Utsi. I just noticed that issue last night and you nailed it alreadyPlayer: Popcorn Hour A-110 Router: Linksys-Cisco WRT54GL (DD-WRT) (TCP Vegas enabled) SC server: QNAP TS-109 II Lighttpd v1.4.23-1 PHP v5.2.11 MySQL v5.0.27-log NAS Server: QNAP TS-109 II
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/08/07 18:01No problem But if you, or anyone else, find issues with the parser, please post it here. Otherwise it may take a long time before I see it myself.
I've been kind of busy playing with my new gadget, a squeezebox, lately, so haven't seen so many movies. I find squeezebox/squeezecenter to be the same to audio as popcornhour/swisscenter is to video, in other words a must.Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
patrick2525
User
Posts: 13
Re: IMDb SmartSearch parser released - 2009/08/15 09:15This looks great - I wish I found this thread a couple of weeks ago when I was experiencing the same initial issues and started down the same road of tweaking the imdb parser.
But when I went to try this out (via Search for New Media), it seems to be just looping and the status keeps refreshing to read 'parsing movie details' for hours, even though I only have 1 movie in my media location. Eventually I stopped it and ran a 'select count(*) on actors', which resulted in 0.
When I switched back to the original parser (via Media Management -> Videos) and rerun, the original Simese parser finishes quickly (but with the dubious results).
I initially tried this SmartSearch on SVN 1292, then updated to 1295, but same results.
Attached is my logfile (logging mode level 9) inwhich I cleaned everything up and let it rescan for a couple of minutes.
Webserver : Apache v2.2.13 PHP : v5.2.10 MySQL : v5.1.37-community SwissCenter : SVN Revision [1318] Player: eGreat M31b Server: Windows 2003 x64 EE
| | The administrator has disabled public write access.
Utsi
Visitor
Re: IMDb SmartSearch parser released - 2009/08/16 05:43Hey patrick, thank you for a good and detailed bug report.
I've re-created the situation locally using svn 1295, and find that the parsers doesn't seem to work for image files. Tried: /media/MyBook2/Movies/30_Days_of_Night_(2007)/30_Days_of_Night_(2007).iso and /media/MyBook2/Movies/30_Days_of_Night_(2007)/30_Days_of_Night_(2007).img
but they doesn't even get recognized by swisscenter as movies (both smartsearch and regular parser). If I, however, rename the files to use a .mkv or .mpg extension, it works like a charm.
I did not manage to get an endless loop, but I got the server to freeze a couple of times.
As I can see it, this has got to be a problem with the way swisscenter handles image files.
Pernod, have you got any ideas?
| | The administrator has disabled public write access.
Pernod
Admin
Posts: 2783
Re: IMDb SmartSearch parser released - 2009/08/16 08:12I just created a file with name 30_Days_of_Night_(2007).iso in my DVD's folder and SwissMonitor detected it and added it to my database. By default I have themoviedb parser selected and this automatically got the correct images and details. No problems here.
I can only think that Download Extra Info is not selected for the category assigned to your media location.Players : Netgear EVA700 | Popcorn A-100 (091202) | Popcorn A-200 (100208) Webserver : Simese v2.6.4 | Apache 2.2.14 | PHP v5.2.12 | MySQL v5.1.32 Server : Windows 7 Home Premium 64bit Spec : Intel C2Q Q6600 - 4GB RAM - 3TB HDD AV : Pioneer VSX-915 | Samsung LE40C650
| | The administrator has disabled public write access.
patrick2525
User
Posts: 13
Re: IMDb SmartSearch parser released - 2009/08/16 12:32Hey guys - sorry I wasn't around when yall were discussing this, but here's a play-by-play of the steps I've done to try to narrow down the issue...
1)Clear the database 1.1) Using Windows Explorer, move all movies out of my Movies share. 1.2) Search for New Media -> 'All', 'All', 'Yes', 'No', 'Yes' 1.3) Edit the Database -> 'select count(*) from movies;' >> 0
2)Add movie and metadata using SmartSearch 2.1) Using Windows Explorer, move a single movie directory to Movies share 2.2) Media Mgmt -> Videos -> 'www.imdb.com[SmartSearch]', 'MPAA', 'Enabled', 'Disabled' -> Save 2.3) Search for New Media -> 'All', 'All', 'Yes', 'No', 'Yes' 2.4) This is where it loops with status of 'parsing movie details' 2.5) Edit the Database -> 'select count(*) from movies;' >> 1 2.6) Edit the Database -> 'select count(*) from actors;' >> 0
3)Clear database 3.1) Same as Step 1
4)Add movie and metadata using SwissCenter imdb parser 4.1) Using Windows Explorer, move a single movie directory to Movies share 4.2) Media Mgmt -> Videos -> 'www.imdb.com','MPAA', 'Enabled','Disabled' -> Save 4.3) Search for New Media -> 'All', 'All', 'Yes', 'No', 'Yes' 4.4) This completes in about 10 seconds 4.5) Edit the Database -> 'select count(*) from movies;' >> 1 4.6) Edit the Database -> 'select count(*) from actors;' >> 15
Sorry if this is too much detail
I've also tried the above steps using a movie directory with VIDEO_TS subfolders, as well as renaming the 30_Days_of_Night_(2007).iso to *.avi; same symptoms. The logfile shows that it was found, but the SS parser keeps looping whereas the SC parser seems to work OK.
Thanks!Webserver : Apache v2.2.13 PHP : v5.2.10 MySQL : v5.1.37-community SwissCenter : SVN Revision [1318] Player: eGreat M31b Server: Windows 2003 x64 EE
| | The administrator has disabled public write access.
Utsi
Visitor
Re: IMDb SmartSearch parser released - 2009/08/16 14:49There's no such thing as too much information But you could reduce the log level to 8 so that we don't get all that sql.
What I find extremely weird here, is that even though there is no logging from the SmartSearch parse (in the log you attached), the movie is still added to the database. Could parser file be corrupted?
What you could try, is this: 1) Download the latest version of this parser once again and extract the zip file to the correct folder. 2) Open it in a text editor, and on the first line in the function in the top, add a log statement like this:
Code:
function extra_get_movie_details($id, $filename, $title)
{
send_to_log(4, "Patrick's test");
...
3) Close the file and run the parser again.
If you are able to see the log statement in the log, the parser is crashing. Otherwise, it crashes before the parser gets called, in which case you may try to copy the code from the original parser into this parsers file just to confirm that swisscenter can see the file.
This may seem far fetched, but I can't see any other logical explanation:-s
| | The administrator has disabled public write access.
Pernod
Admin
Posts: 2783
Re: IMDb SmartSearch parser released - 2009/08/16 15:01I would suggest checking the short_open_tags option in your php.ini. The Simese 2.5.7 installer has this set to Off, whereas Utsi's parser has a short open tag so the file will not be interpreted.
The 2.5.9 installer has short_open_tags = On.
We've had lots of support issues because of this setting. The official parser also had short open tags a while ago but is now fixed in latest SVN.Players : Netgear EVA700 | Popcorn A-100 (091202) | Popcorn A-200 (100208) Webserver : Simese v2.6.4 | Apache 2.2.14 | PHP v5.2.12 | MySQL v5.1.32 Server : Windows 7 Home Premium 64bit Spec : Intel C2Q Q6600 - 4GB RAM - 3TB HDD AV : Pioneer VSX-915 | Samsung LE40C650
| | The administrator has disabled public write access.
patrick2525
User
Posts: 13
Re: IMDb SmartSearch parser released - 2009/08/16 17:59OK, gotcha...
Utsi - I did as you suggested; redownloaded the 00004 version and added the 'Patrick test' line. I cleaned the db out and retried: same looping issue, and the 'Patrick test' didn't appear in the log.
I then copied all the text from the original SC parser in the SS file (replacing all text), and also added the 'Patrick test' line as before. This time it worked the line showed up in logfile as well.
I've attached the logs from both trials for comparison - it indeed looks like something is crashing before it gets to the parser.
Pernod - I kind of got lost about what you were saying The short_open_tag = Off in my php.ini file. Were you saying to switch it On, or just check to insure its Off ?
And also... I'm not sure if its normal (or maybe a culprit of this whole issue), but I have 4 php.ini files installed: C:\PHP C:\Windows C:\Program Files (x86)\PHP C:\Documents and Settings\All Users\Application Data\Simese\Php
They all had short_open_tag = Off, but I'm guessing that the one in the Simese directory is the one we're looking at, yes?
Webserver : Apache v2.2.13 PHP : v5.2.10 MySQL : v5.1.37-community SwissCenter : SVN Revision [1318] Player: eGreat M31b Server: Windows 2003 x64 EE
| | The administrator has disabled public write access.
patrick2525
User
Posts: 13
Re: IMDb SmartSearch parser released - 2009/08/16 18:08OK... I should have just tried this before posting the previous...
I set short_open_tag = On in the C:\Documents and Settings\All Users\Application Data\Simese\Php\php.ini file.
Search for new media ... completed (!).
select count(*) from actors; >> 46
So great call Pernod! But still I'm a little confused about this setting - should it be set to Off or On, and will my switching it On effect other updates to SC?
Much appreciated! Webserver : Apache v2.2.13 PHP : v5.2.10 MySQL : v5.1.37-community SwissCenter : SVN Revision [1318] Player: eGreat M31b Server: Windows 2003 x64 EE
| | The administrator has disabled public write access.
Pernod
Admin
Posts: 2783
Re: IMDb SmartSearch parser released - 2009/08/16 18:15So great call Pernod! But still I'm a little confused about this setting - should it be set to Off or On, and will my switching it On effect other updates to SC? Ideally it should be Off but Utsi's parser requires it to be On. This will not affect any other SC updates as the rest of SC works with it On or Off.Players : Netgear EVA700 | Popcorn A-100 (091202) | Popcorn A-200 (100208) Webserver : Simese v2.6.4 | Apache 2.2.14 | PHP v5.2.12 | MySQL v5.1.32 Server : Windows 7 Home Premium 64bit Spec : Intel C2Q Q6600 - 4GB RAM - 3TB HDD AV : Pioneer VSX-915 | Samsung LE40C650
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/08/17 00:47I see you guys worked this out beautifully while I was asleep
Pernod, are you saying that if I change the very first line in my parser from "<?" to "<?php" I will rid the Simese users of these hiccups?
Things like this can happen when people like me start doing stuff they don't know, like coding php Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Pernod
Admin
Posts: 2783
Re: IMDb SmartSearch parser released - 2009/08/17 05:22Pernod, are you saying that if I change the very first line in my parser from "<?" to "<?php" I will rid the Simese users of these hiccups? Correct.
Do you want me to tidy up the thread and remove any non relevant posts?Players : Netgear EVA700 | Popcorn A-100 (091202) | Popcorn A-200 (100208) Webserver : Simese v2.6.4 | Apache 2.2.14 | PHP v5.2.12 | MySQL v5.1.32 Server : Windows 7 Home Premium 64bit Spec : Intel C2Q Q6600 - 4GB RAM - 3TB HDD AV : Pioneer VSX-915 | Samsung LE40C650
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/08/17 14:36Here's an updated version of the parser that should run without problems with Simese.
Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/09/16 15:03Fixed a bug: If the movie name contained more than one escape character, the code would go into an endless loop.
Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Dutchsea
User
Posts: 277
Re: IMDb SmartSearch parser released - 2009/11/07 06:06Hi, from previous discussions I understood it was possible to add the IMDB number, such as tt0389557, to the file name in order to facilitate the search process. I cant find the tread(s) anymore and maybe the IMDB smartparser does not facilitate this function. Can somebody point me to the right tread and/or tell me if SmartSearch facilitates this and how?QNAP TS-509 (1.6 MHz, 4 GB ) – Linux - PHP 5.2.11, MySQL 5.1.36 & Apache ??? – Swisscenter SVN [1405] Custom PC (2.8 MHz, 4GB ) – Windows 7 Pro - PHP 5.2.9-1, MySQL 5.1.32 & Simese v2.5.10 - Swisscenter SVN [1376] Synology CS407 (0.5 MHz, 128 ) – Linux - PHP 5.2.10, MySQL 5.1.34 & Apache
| | The administrator has disabled public write access.
Stu2j
User
Posts: 2307
Re: IMDb SmartSearch parser released - 2009/11/07 11:05Dutchsea wrote: Hi, from previous discussions I understood it was possible to add the IMDB number, such as tt0389557, to the file name in order to facilitate the search process. I cant find the tread(s) anymore and maybe the IMDB smartparser does not facilitate this function. Can somebody point me to the right tread and/or tell me if SmartSearch facilitates this and how? It is added to the filename like this:
The Movie Name [tt0389557].avi
I have no idea if it works with this parser..Showcenters 1000g/250HD/Popcorn Hour A-100 Netgear HDX101 Powerline Adapters Windows XP SP3 Simese 2.6.4 Beta SwissCenter latest SVN NAS Server Intel PD 2.66Ghz/2GB Mem/1.5TB Storage Hauppauge HVR 1600 GB-PVR
| | The administrator has disabled public write access.
Dutchsea
User
Posts: 277
Re: IMDb SmartSearch parser released - 2009/11/07 17:32But isn't everything between square brackets discarded by the parser?QNAP TS-509 (1.6 MHz, 4 GB ) – Linux - PHP 5.2.11, MySQL 5.1.36 & Apache ??? – Swisscenter SVN [1405] Custom PC (2.8 MHz, 4GB ) – Windows 7 Pro - PHP 5.2.9-1, MySQL 5.1.32 & Simese v2.5.10 - Swisscenter SVN [1376] Synology CS407 (0.5 MHz, 128 ) – Linux - PHP 5.2.10, MySQL 5.1.34 & Apache
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2009/11/27 16:34Synopsis wasn't fetched, they changed the page layout. Here's an update that takes care of that.
@Dutchsea: This parser handles imdb numbers like the official parser.
Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Dutchsea
User
Posts: 277
Re: IMDb SmartSearch parser released - 2009/11/27 19:02Thanks, I will try it when my NAS is OK again. One disk failed (Hurrah for raid 5 ) and I am waiting for the new disk to be deliveredQNAP TS-509 (1.6 MHz, 4 GB ) – Linux - PHP 5.2.11, MySQL 5.1.36 & Apache ??? – Swisscenter SVN [1405] Custom PC (2.8 MHz, 4GB ) – Windows 7 Pro - PHP 5.2.9-1, MySQL 5.1.32 & Simese v2.5.10 - Swisscenter SVN [1376] Synology CS407 (0.5 MHz, 128 ) – Linux - PHP 5.2.10, MySQL 5.1.34 & Apache
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2010/01/01 16:58Happy new year!
I've made a few changes to the parser: -Sequel friendlyness: When searching for "Rambo 2" you now get "Rambo: First Blood Part II", "Terminator 3" will return "Terminator 3: Rise of the Machines" (and NOT "Terminator 5") and so on. (It translates numbers 2-10 to II-X when analysing the results returned from imdb).
-Added faith in the results from IMDb: It seems that in most cases the first result from IMDb is the best one. Therefore, if the first result has a greater hit percentage than 75%, just keep it and don't bother about the other results.
I would appreciate feedback on this as I've only got ~100 movies to run my tests on.
Player: Popcornhour A-100 Server: Ubuntu 9.04, lighttpd/fastcgi System specs: Intel Pentium 4 CPU 2GHz, 756MB RAM
| | The administrator has disabled public write access.
Dutchsea
User
Posts: 277
Re: IMDb SmartSearch parser released - 2010/01/03 12:29Hi Utsi,
Thanks for the new version of the parser. I tried it and it works better for me than ever before. (for about 450 movies)
Some observations (not 100% sure if these can all be atributed to this new version of the parser:
1. I now also get results for movies with non-english titles (i.e. dutch or chinese titels). In the past I had to provide the translated English title but now the original tile also works.
2. It works best if I use the add/update details function in the edit video details menu on the config page. In that case all details are refreshed. (Except the jpg file if it already exists. If it exist, the jpg is not replaced)
For some reason the media search function does not refresh the media details of existing movies even though I use the refresh all extra information button in the videos menu. I will probably work better if I delete the xml sidecar files before the media search. I will try that later.
I dont know if this is a parser issue or a general media search issue.
3. Not sure about the sequel friendliness. I looks like I dont have that many movies that the profile. I do have Mission: Impossible III listed in my movie overview but not sure if this is done by the new parser.
4. I had 1 issue with a movie that has a remake with exactly the same tittle. The parser picks the newest release. So my Battlestar Galactica movie from 1978 was parsed as the remake from 2004 every time. Any smart ideas how to solve that? .
I still feel it would be handy to have a option (maybe in the xml sidecar) to use the IMDB number (such as tt0076984) to identify a difficult movie. It guarantess 100% accuracy.
Side note: The list with actors is very long in most cases. Can that be parameterised somewhere? For example that only the first 8 actors are captured? (I remember that I read a post about this before but not sure when and where)QNAP TS-509 (1.6 MHz, 4 GB ) – Linux - PHP 5.2.11, MySQL 5.1.36 & Apache ??? – Swisscenter SVN [1405] Custom PC (2.8 MHz, 4GB ) – Windows 7 Pro - PHP 5.2.9-1, MySQL 5.1.32 & Simese v2.5.10 - Swisscenter SVN [1376] Synology CS407 (0.5 MHz, 128 ) – Linux - PHP 5.2.10, MySQL 5.1.34 & Apache
| | The administrator has disabled public write access.
Utsi
Visitor
Re: IMDb SmartSearch parser released - 2010/01/03 14:25Dutchsea wrote: Hi Utsi,
Thanks for the new version of the parser. I tried it and it works better for me than ever before. (for about 450 movies)
Some observations (not 100% sure if these can all be atributed to this new version of the parser:
1. I now also get results for movies with non-english titles (i.e. dutch or chinese titels). In the past I had to provide the translated English title but now the original tile also works.
2. It works best if I use the add/update details function in the edit video details menu on the config page. In that case all details are refreshed. (Except the jpg file if it already exists. If it exist, the jpg is not replaced)
For some reason the media search function does not refresh the media details of existing movies even though I use the refresh all extra information button in the videos menu. I will probably work better if I delete the xml sidecar files before the media search. I will try that later.
I dont know if this is a parser issue or a general media search issue.
3. Not sure about the sequel friendliness. I looks like I dont have that many movies that the profile. I do have Mission: Impossible III listed in my movie overview but not sure if this is done by the new parser.
4. I had 1 issue with a movie that has a remake with exactly the same tittle. The parser picks the newest release. So my Battlestar Galactica movie from 1978 was parsed as the remake from 2004 every time. Any smart ideas how to solve that? .
I still feel it would be handy to have a option (maybe in the xml sidecar) to use the IMDB number (such as tt0076984) to identify a difficult movie. It guarantess 100% accuracy.
Side note: The list with actors is very long in most cases. Can that be parameterised somewhere? For example that only the first 8 actors are captured? (I remember that I read a post about this before but not sure when and where)
Thanks for the testing, this is exactly the kind of feedback I need
1. Yes, I think that's because of the adjustments I've made, if the name isn't totally different from the original name. If there are special characters in the name I've made the parser more friendly to those too.
2. Generally, I would say the best way to test is to type "delete from movies" in "edit database" and doing a full search afterwards. This can take some time, though.
3. That movie could as well have been read by the previous version of the parser, it depends on the file name.
4. If the file name isn't "battlestar.gallectica.720p.1978.dutchsea.mkv" etc or lies in a folder with "1978" in it, the parser will pick the most recent one. Or do you have the year in the file name or folder name?
The [tt0076984] number (in square brackets) in the file name works for now, but that's an absolute last resort, I'm doing my best to avoid it.
As for the actor list, IMDb doesn't make sure the most relevant actors appear on the first page, therefore I unfortunately need to include all in order not to miss any of the stars. But if that causes problems for someone with a lot of movies, I will consider changing the parser back to only use the actors from the first page.
| | The administrator has disabled public write access.
Dutchsea
User
Posts: 277
Re: IMDb SmartSearch parser released - 2010/01/04 15:16Hi again,
My movie path & file name is: //192.168.1.10/Video/Speelfilms/Sciene Fiction/Battlestar Galactica [The Movie] (1978).avi
Despite the year in the title, the most recent version of this movie was selected from IMDB.
Also for some reason adding the imdb number (such as [tt0076984]) does not work in my case.QNAP TS-509 (1.6 MHz, 4 GB ) – Linux - PHP 5.2.11, MySQL 5.1.36 & Apache ??? – Swisscenter SVN [1405] Custom PC (2.8 MHz, 4GB ) – Windows 7 Pro - PHP 5.2.9-1, MySQL 5.1.32 & Simese v2.5.10 - Swisscenter SVN [1376] Synology CS407 (0.5 MHz, 128 ) – Linux - PHP 5.2.10, MySQL 5.1.34 & Apache
| | The administrator has disabled public write access.
Utsi
User
Posts: 203
Re: IMDb SmartSearch parser released - 2010/01/04 15:37Hi, I found the reason why the battlestar from 1978 didn't work. I've made some updates and now I believe it should work. If there is a year in the file name or the folder name, it will traverse through the results returned from imdb until it finds one with the exactly same year. This time it found all my movies.
I don't know much about the tt-number in the file name because I haven't actually tried it myself. Will come back to that later if it turns out that it works in the official parser and not in mine.
Forums 
But if you, or anyone else, find issues with the parser, please post it here. Otherwise it may take a long time before I see it myself. 
The short_open_tag = Off in my php.ini file. Were you saying to switch it On, or just check to insure its Off ?
