Navigation » MPC Club Community Board > News and Info Section > News Articles and Discussions » NMJ Scraping Guide by Hi-Jack

Notices

» Slysoft Recommended!
1 CLick BD and DVD backups
Download AnyDVD HD!
For Blu-Ray and DVD!
» Log in
User Name:

Password:

Not a member yet?
Register Now!
» Stats
Members: 85,407
Threads: 29,402
Posts: 248,023
Welcome to our newest member, sikula1978
» MPC Club Advertisers and Sponsors
Reply
 
Thread Tools
Old 11-11-10, 11:49   #1
Hi-Jack

Think Tank
 
Hi-Jack's Avatar
 
Join Date: Nov 2003
Location: Belgium
Posts: 23,322
Contribution: 9.39%
Blog Entries: 12
Thanks: 22
Thanked 3,435 Times in 601 Posts
Downloads: 0
Uploads: 0
Arrow NMJ Scraping Guide by Hi-Jack

Ok, it's not the best guide we ever wrote but the best we could come up with given the time we have to "guide" you inside the NMJ movie scraping world... We created both a guide and a tool that aid in preparing your movie content in a way "we feel it's ok". It may not be the best method (it's too new to fully grasp everything) and it may not be a method you like considering the time it takes, but it's a method none the less we feel is pretty ok to use...

All files needed are linked inside the guide.
We take no responsibility for anything you do with the guide or tools provided. As always, better be safe than sorry. Start with a few files and make sure everything is backed up until you are familiar and confident using these tools.

Download the Guide:
http://www.mpcclub.com/temp/dummy_nmjscraping.pdf

In case we made a mess of anything (guide or tool) rushing our way forward, we will try and address issues as they are reported in this thread only...

Notice: Initially we stated BDMV caused issues scraping, this was due to incomplete sources (stripped backups). We can happily state both VIDEO_TS and BDMV are scraped without issues.

TIPS:
- When using NMJ, after restart default behavior is the old list system. Change it if you wish.
http://www.networkedmediatank.com/sh....php?tid=46189

- When adding series, name the structure as follows:
  • Fringe 1
    • Fringe.nfo (containing IMDB link for the serie)
    • Fringe S01E01 - Title.avi
    • Fringe S01E02 - Title.avi etc...
- Keep in mind, scanning takes a lot of time from the player. Add in batches. I created a new share and move content prepped over there by batches, having the database rescan content and update itself... Or you can leave on the unit for as long as it takes for batch processing...

- Work with a single share as main source... I'm not pro multiple shares as they require each their own DB. 1 share with huge volume is a benefit to keep things located into one single DB. Make sure you have some automated backup setup for the DB Files for restore if ever issues shall arise. (nmj_database)

For instance:
  • MediaWall
    • Videos
      • AVI
      • HD
      • BD
      • DVD
    • Music
      • Album 1
      • Album 2
      • Artist
        • Album 1
        • Album 2
      • songs.mp3
    • Images
      • Holiday on Ice
      • Holiday in Spain
      • Holiday in Greece
      • Sex with 15 girls in 48 hours
etc...

- In several occasions we got stuck navigating. There's possibly a way out but we can't find it. (Shows the complexity of things). Be prepared to reboot occasionally in order to access your sources again. (What I do, is press "all" and then "Video" on the remote taking me back to the movies.)

- IMDB is not a good source for series. Series which run in numbers (more than 1) will all get the same cover art since IMDB uses one link only to enlist all episodes. This is a limitation for now that will be addressed in the future (or by tools scraping the info from sources like TV.com and then some...)

It takes some thinking to use this system at the best possible currently. We do not think it is ready for mainstream yet (too much hassle) so if you don't want to work hard to go to NMJ heaven, wait for V2 (can take months). In any other case, we do our best to help
Attached Thumbnails
nmjguide.gif  
__________________
Regards
Hi-Jack
___________________________________________
MyMovies for NMJ: Starts here!
Slysoft: 1 Click Backup for BD and DVD
MPC's Recommended Stores

Last edited by Hi-Jack; 12-11-10 at 23:00.
Hi-Jack is offline   Reply With Quote
The Following 7 Users Say Thank You to Hi-Jack For This Useful Post:
chuwak (20-11-10), DVDPhreak (12-11-10), gdawg (12-11-10), MikeHunter (13-11-10), nilis (11-11-10), NMJ (11-11-10), PhileasFogg (11-11-10)
Advertising
Advertising temporarily disabled
Old 11-11-10, 12:29   #2
Dave_D
Premium Potential
TIP: Upgrade to Premium
Addicted to MPC
 
Join Date: Feb 2010
Posts: 79
Contribution: 0.03%
Thanks: 5
Thanked 7 Times in 7 Posts
Downloads: 0
Uploads: 0
Default Re: NMJ Scraping Guide by Hi-Jack

BDMV scanning works.
DVD scanning works too.

No utility needed.
Dave_D is offline   Reply With Quote
Old 11-11-10, 13:03   #3
Hi-Jack

Think Tank
 
Hi-Jack's Avatar
 
Join Date: Nov 2003
Location: Belgium
Posts: 23,322
Contribution: 9.39%
Blog Entries: 12
Thanks: 22
Thanked 3,435 Times in 601 Posts
Downloads: 0
Uploads: 0
Default Re: NMJ Scraping Guide by Hi-Jack

Syabas just informed us as well. We seem to have stripped some content from BDMV files causing this. As long as BDMV includes the PLAYLIST folder containing the mpls it will be detected. Otherwise, it will try to index any and all m2ts files it finds and that's causing a slowdown...

Before making comments though about the guide and tool i developed, read what the guide is about. It has nothing to do with BDMV or VIDEO_TS scraping.

Guide is updated to reflect the latest developments
__________________
Regards
Hi-Jack
___________________________________________
MyMovies for NMJ: Starts here!
Slysoft: 1 Click Backup for BD and DVD
MPC's Recommended Stores

Last edited by Hi-Jack; 11-11-10 at 13:17.
Hi-Jack is offline   Reply With Quote
Old 11-11-10, 13:58   #4
nilis

Experienced Member
 
nilis's Avatar
 
Join Date: Sep 2009
Location: Netherlands
Posts: 113
Contribution: 0.05%
Thanks: 29
Thanked 10 Times in 9 Posts
Downloads: 0
Uploads: 0
Default Re: NMJ Scraping Guide by Hi-Jack

In the guide I noticed that the url that is place in the re-parsed nfo file is not correct. The 'title/' part is missing.
The url should read :
However, I guess nmj searches for the 'tt' combination and takes the numbers after the 'tt'-combination so it still works. However, when you also want to use yamj, it is likely that there will be an error during the reading of the nfo file since the web page http://www.imdb.com/ttxxxxxxx does not exist....
nilis is offline   Reply With Quote
Old 11-11-10, 14:18   #5
Hi-Jack

Think Tank
 
Hi-Jack's Avatar
 
Join Date: Nov 2003
Location: Belgium
Posts: 23,322
Contribution: 9.39%
Blog Entries: 12
Thanks: 22
Thanked 3,435 Times in 601 Posts
Downloads: 0
Uploads: 0
Default Re: NMJ Scraping Guide by Hi-Jack

oops. You are correct. Told you, rushing is never good
It indeed still works but still must be corrected...

Will quickly update the code so it corrects the IMDB links that exist already...
__________________
Regards
Hi-Jack
___________________________________________
MyMovies for NMJ: Starts here!
Slysoft: 1 Click Backup for BD and DVD
MPC's Recommended Stores
Hi-Jack is offline   Reply With Quote
Old 11-11-10, 14:54   #6
Hi-Jack

Think Tank
 
Hi-Jack's Avatar
 
Join Date: Nov 2003
Location: Belgium
Posts: 23,322
Contribution: 9.39%
Blog Entries: 12
Thanks: 22
Thanked 3,435 Times in 601 Posts
Downloads: 0
Uploads: 0
Default Re: NMJ Scraping Guide by Hi-Jack

Done! Re-download the package and reinstall (will overwrite all files, close application first)...

Fixes:
- Corrects IMDB link to inlcude "/title/" for existing nfo's (Thx nillis for reporting)
- Creates the link correctly including "/title/" (Thx nillis for reporting)

(Note: it remains a quick and dirty little script developed in 30 mins )
__________________
Regards
Hi-Jack
___________________________________________
MyMovies for NMJ: Starts here!
Slysoft: 1 Click Backup for BD and DVD
MPC's Recommended Stores
Hi-Jack is offline   Reply With Quote
Old 11-11-10, 15:23   #7
NMJ
Premium Potential
TIP: Upgrade to Premium
Active Member
 
Join Date: Aug 2010
Posts: 18
Contribution: 0.01%
Thanks: 3
Thanked 3 Times in 2 Posts
Downloads: 0
Uploads: 0
Default Re: NMJ Scraping Guide by Hi-Jack

thumbs up!
NMJ is offline   Reply With Quote
Old 11-11-10, 15:26   #8
nilis

Experienced Member
 
nilis's Avatar
 
Join Date: Sep 2009
Location: Netherlands
Posts: 113
Contribution: 0.05%
Thanks: 29
Thanked 10 Times in 9 Posts
Downloads: 0
Uploads: 0
Default Re: NMJ Scraping Guide by Hi-Jack

Originally Posted by Hi-Jack View Post
Done! Re-download the package and reinstall (will overwrite all files, close application first)...

Fixes:
- Corrects IMDB link to inlcude "/title/" for existing nfo's (Thx nillis for reporting)
- Creates the link correctly including "/title/" (Thx nillis for reporting)

(Note: it remains a quick and dirty little script developed in 30 mins )
You're welcome

Thanks for the script. I guess it will make life a little bit easier
nilis is offline   Reply With Quote
Old 12-11-10, 09:43   #9
jockeihabo
Premium Potential
TIP: Upgrade to Premium
Active Member
 
Join Date: Oct 2008
Posts: 14
Contribution: 0.01%
Thanks: 0
Thanked 0 Times in 0 Posts
Downloads: 0
Uploads: 0
Default Re: NMJ Scraping Guide by Hi-Jack

Hi Jack

I've tried to use the script to convert my super duper nfo:s to the tt only. The strange this is it doesn't find any compatible, just 0 0 0 on all. I tried some different folders with the same result in all.

They look like this:


si="http://www.w3.org/2001/XMLSchema-instance" xmlnssd="http://www.w3.org/2001/XMLSchema">
tt0337563
13 Going on 30
13 Going on 30
2004
2004-06-30
0
USA:PG-13 / UK:12A / Switzerland:7 / Switzerland:7 / South Korea:15 / Singapore:PG / Portugal:M/12 / Philippines:PG-13 / Norway:A / Netherlands:AL / Netherlands:12 / Malaysia:U / Ireland:12 / Iceland:L / Germany.Al. / France:U / Finland:K-3 / Chile:TE / Canada:PG / Canada:G / Brazil:Livre / Australia:PG / Argentina:Atp
Comedy / Fantasy / Romance
Revolution Studios
Gary Winick
Josh Goldsmith / Cathy Yuspa
After total humiliation at her thirteenth birthday party, Jenna Rink wants to just hide until she's thirty. Thanks to some wishing dust, Jenna's prayer has been answered. With a knockout body, a dream apartment, a fabulous wardrobe, an athlete boyfriend, a dream job, and superstar friends, this can't be a better life. Unfortunetly, Jenna realizes that this is not what she wanted. The only one that she needs is her childhood best friend, Matt, a boy that she thought destroyed her party. But when she finds him, he's a grown up, and not the same person that she knew.
http://hwcdn.themoviedb.org/posters/b2c/4bc92be2017a3c57fe011b2c/13-going-on-30-cover.jpg
http://www.movieposterdb.com/posters/05_11/2004/0337563/l_64715_0337563_d792276e.jpg
http://www.movieposterdb.com/posters...l_8779_0337563

and so on...

What can the problem be?
jockeihabo is offline   Reply With Quote
Old 12-11-10, 10:07   #10
werner99

Experienced Member
 
Join Date: Jun 2008
Location: Austria
Posts: 165
Contribution: 0.07%
Thanks: 1
Thanked 20 Times in 10 Posts
Downloads: 0
Uploads: 0
Default Re: NMJ Scraping Guide by Hi-Jack

how should it find an tt number if you don't have one inside your nfo file? on your sample i see only links to themoviedb, movieposterdb.
NMJ supports only IMDB .
__________________
<p>Europe Country Manager</p><p>Syabas Technology</p>
werner99 is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On


» MPC top List...

TOP 5 Regular media players

  • Popcorn Hour C-300 (81%)
  • Mede8er Med500x2 (80%)
  • Dune SMART (D1) (65%)
  • HDI Dune Base 3.0 (52%)
  • DViCo TViX X-Roid (00%)

TOP 5 Hybrid media players

  • HDI Dune BD Prime 3.0 (75%)
  • HDI Dune HD SMART B1 (74%)
  • PoPCorn Hour C-200 (68%)
  • HDI Dune MAX (54%)

We do not recommend currently...

  • Xtreamer products
  • Hantech products
  • MViX products
  • DviCo products
  • HDX products
Powered by vBadvanced CMPS v3.2.1 - twisted by vbTwist and Hi-Jack (MPC Club)