Margaritaville TV shows

[SunLover]

Luckily for the parrotheads, this parrothead knows how to rip youtube live streams I have posted up 3 of the shows for ya'll!

If you don't mind me asking, what are you using to rip live youtube streams?

[coasterghost]

Luckily for the parrotheads, this parrothead knows how to rip youtube live streams I have posted up 3 of the shows for ya'll!

If you don't mind me asking, what are you using to rip live youtube streams?

I edit the youtube M3U8 play list at the start and again at the end if the broadcasts to get the links for each segement file and then making it into one file and use a download manager to get the files in order. I can make an example during the next show. Thats to get the full broadcast. You can also use the file with chrome where it is for example [link}/index.m3u8?seg=668 (that is playable in VLC to capture.)

[coasterghost]

Since sunlover asked, here is how I rip youtube. Here is basically the way I rip the webcasts that allows me to get the entire video they stream. From There, I usually edit it down while keeping the masters as a backup. There are a bit too many steps, but it works extremely well.

Now that Margaritaville.tv now has the player on the watch page, here is what you do. (I'll be using Google I/O Day 2 Room 8 Live stream for the basis of this guide)

NOTE: In the youtube playlist files, it lists your public IP address. So for this guide, I’ve replaced my IP address with “##.###.###.###” So the Links are “…ip/[Your public IP]/ipbits/…” In this guide they are marked as “…ip/##.###.###.###/ipbits/…”. ALL INSTANCES OF MY IP ADDRESS ARE SHOW AS ##.###.###.### for network security purposes.

1. Right click the video player and click "Copy embed code"
Now a copy embed code will look like this

Code: Select all

<iframe width="640" height="360" src="//www.youtube.com/embed/5WI_lCmBKE8?feature=player_detailpage" frameborder="0" allowfullscreen></iframe>

2. Open in a text editor and copy the embed link, it should look like this:

Code: Select all

www.youtube.com/embed/5WI_lCmBKE8

3. Now open a new tab ( I use Google Chrome for this) and press F12 (Windows) or Cmd + Opt + I (Macintosh) and make sure that network is click Network to get real time network links (much easier than Firefox HTTP Headers) and then paste the the link into the browser.

4 Now start to play the video and use the gear icon and select the highest quality stream and then from there verify that the gear icon is no longer spinning and that it says 'HD" (for HD Streams). Now you will see "seg.ts" files and "index.m3u8?start_seg=#"

5. Copy the link for the index.m3u8 file. It should look something like this:

Code: Select all

https://manifest.googlevideo.com/api/manifest/hls_playlist/id/5WI_lCmBKE8.1/itag/96/source/yt_live_broadcast/requiressl/yes/ratebypass/yes/live/1/cmbypass/yes/gir/yes/dg_shard/5WI_lCmBKE8.1_96/hls_chunk_host/r13---sn-ab5l6n7r.googlevideo.com/playlist_type/DVR/pmbypass/yes/gcr/us/sver/3/fexp/902408,914052,915507,924222,930008,930802,932110,934030,940601,947362/upn/0uqYzJgejww/cpn/hLfQjMSPN8jz3x8P/ms/lv/mt/1403800987/mv/m/mws/yes/ip/##.###.###.###/ipbits/0/expire/1403823600/sparams/ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,gir,dg_shard,hls_chunk_host,playlist_type,pmbypass,gcr/signature/2471CA887336C14A43A283B4AC6DFF775DEA3D30.3E62D91AACE7D0817E733F826B068FAFC06CE5A2/key/dg_yt0/file/index.m3u8?start_seq=757

This is where I will go alternate path so A=Notepad++ B=VLC C=FFMpeg.exe(using commands)

6a. Copy the link into a new tab and if you can still access videos before the 4 hour mark, remove "?start_seq=#" from the link and press enter, It should download or it should open a file window to download it and press save. IF you did remove the "?start_seg=#" then it should look like when you open it in Notepad++ like this:

Code: Select all

#EXTM3U
#EXT-X-VERSION:3
#EXT-X-TARGETDURATION:7
#EXT-X-MEDIA-SEQUENCE:0
#EXTINF:5.005000,
https://r13---sn-ab5l6n7r.googlevideo.com/videoplayback/id/5WI_lCmBKE8.1/itag/96/source/yt_live_broadcast/sq/0/file/seg.ts?requiressl=yes&ratebypass=yes&cmbypass=yes&gir=yes&dg_shard=5WI_lCmBKE8.1_96&hls_chunk_host=r13---sn-ab5l6n7r.googlevideo.com&playlist_type=DVR&pmbypass=yes&gcr=us&sver=3&fexp=902408,914052,915507,924222,930008,930802,932110,934030,940601,947362&upn=0uqYzJgejww&cpn=hLfQjMSPN8jz3x8P&ms=lv&mt=1403800987&mv=m&mws=yes&ip=##.###.###.###&ipbits=0&expire=1403823600&sparams=ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,gir,dg_shard,hls_chunk_host,playlist_type,pmbypass,gcr&signature=2471CA887336C14A43A283B4AC6DFF775DEA3D30.3E62D91AACE7D0817E733F826B068FAFC06CE5A2&key=dg_yt0&live=1&lmt=1403797238959869&clen=1524492&dur=5.005
...

If you did not remove the "?start_seg=#" it should now look like:

Code: Select all

#EXTM3U
#EXT-X-VERSION:3
#EXT-X-TARGETDURATION:7
#EXT-X-MEDIA-SEQUENCE:757
#EXTINF:5.005000,
https://r13---sn-ab5l6n7r.googlevideo.com/videoplayback/id/5WI_lCmBKE8.1/itag/96/source/yt_live_broadcast/sq/757/file/seg.ts?requiressl=yes&ratebypass=yes&cmbypass=yes&gir=yes&dg_shard=5WI_lCmBKE8.1_96&hls_chunk_host=r13---sn-ab5l6n7r.googlevideo.com&playlist_type=DVR&pmbypass=yes&gcr=us&sver=3&fexp=902408,914052,915507,924222,930008,930802,932110,934030,940601,947362&upn=0uqYzJgejww&cpn=hLfQjMSPN8jz3x8P&ms=lv&mt=1403800987&mv=m&mws=yes&ip=##.###.###.###&ipbits=0&expire=1403823600&sparams=ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,gir,dg_shard,hls_chunk_host,playlist_type,pmbypass,gcr&signature=2471CA887336C14A43A283B4AC6DFF775DEA3D30.3E62D91AACE7D0817E733F826B068FAFC06CE5A2&key=dg_yt0&live=1&lmt=1403797238959869&clen=1524492&dur=5.005
...

Note: The Main difference is right here ".../sq/#/file/seg.ts?..." with there the number sign is where the segment file is. When downloading from these links, DO NOT ALTER the links, as some have shorter lengths than others.

6b. Now open VLC and go to Media → Open Network Stream... The Open Media dialog will open, paste the M3U8 stream ***WITH THE '?start_seg=#' so It will play and it must include the start segment number now please note that with the live stream WILL start live and there is no access to the segment file it starts with, and will continue as a live stream. Now Unfold the “Play” button and click on the Convert option. You can also do this by pressing Alt+C in your keyboard.In the Convert dialog you will have to select the location and type of the destination file. Click the Browse button and in the explorer like window you can browse your folders and give a name and extension to the output file. (I use .ts file format) Click OK and you are back to the Convert dialog, here you will be able to select if you want to view the output while recording and the profile. For this example I selected the default Video – H.264 + AAC (MP4) but you can choose the one that best fits your needs. (NOTE: Youtube is H.264 + AAC). Click start and after a few seconds of buffering the live feed video will start being recorded. If there are any disconnects, it should be fine, and the stream will freeze and should pickup again when the stream commences.

6c. Windows (I only use FFmpeg on windows so I typed it here): Open in command prompt (I find it best to keep in the ffmpeg folder a copy of cmd.exe which can be found in “C:\Windows\System32“ now type into the command prompt

Code: Select all

 ffmpeg -i "[Youtube playlist link" -c copy "[filename].ts"

for my example of Google I/O Day 2 it would look like this:

Code: Select all

ffmpeg -i " https://manifest.googlevideo.com/api/manifest/hls_playlist/id/5WI_lCmBKE8.1/itag/96/source/yt_live_broadcast/requiressl/yes/ratebypass/yes/live/1/cmbypass/yes/gir/yes/dg_shard/5WI_lCmBKE8.1_96/hls_chunk_host/r13---sn-ab5l6n7r.googlevideo.com/playlist_type/DVR/pmbypass/yes/gcr/us/sver/3/fexp/902408,914052,915507,924222,930008,930802,932110,934030,940601,947362/upn/0uqYzJgejww/cpn/hLfQjMSPN8jz3x8P/ms/lv/mt/1403800987/mv/m/mws/yes/ip/##.###.###.###/ipbits/0/expire/1403823600/sparams/ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,gir,dg_shard,hls_chunk_host,playlist_type,pmbypass,gcr/signature/2471CA887336C14A43A283B4AC6DFF775DEA3D30.3E62D91AACE7D0817E733F826B068FAFC06CE5A2/key/dg_yt0/file/index.m3u8?start_seq=757" -c copy "GoogleIODay2Rm8.ts"

It will rip until the end of the show, unless there is a disconnect (possibly; I’ve not had this issue before for youtube) which means that I would recommend you an extra command ready in notepad with the filename with the number 2 before the file extension as a just incase)

7a. Check your playlist file in Notepad++ and see where it ends, for example mine ended at segment 758 which would look like this

Code: Select all

 https://r13---sn-ab5l6n7r.googlevideo.com/videoplayback/id/5WI_lCmBKE8.1/itag/96/source/yt_live_broadcast/sq/758/file/seg.ts?requiressl=yes&ratebypass=yes&cmbypass=yes&gir=yes&dg_shard=5WI_lCmBKE8.1_96&hls_chunk_host=r13---sn-ab5l6n7r.googlevideo.com&playlist_type=DVR&pmbypass=yes&gcr=us&sver=3&fexp=902408,914052,915507,924222,930008,930802,932110,934030,940601,947362&upn=0uqYzJgejww&cpn=hLfQjMSPN8jz3x8P&ms=lv&mt=1403800987&mv=m&mws=yes&ip=##.###.###.###&ipbits=0&expire=1403823600&sparams=ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,gir,dg_shard,hls_chunk_host,playlist_type,pmbypass,gcr&signature=2471CA887336C14A43A283B4AC6DFF775DEA3D30.3E62D91AACE7D0817E733F826B068FAFC06CE5A2&key=dg_yt0&live=1&lmt=1403797238959869&clen=1524492&dur=5.005 

Remember the new tab we made with the playlist link? Go back to the link and now just change the “?start_seg=#” to the segment that is after your last one so it would now look like

Code: Select all

https://manifest.googlevideo.com/api/manifest/hls_playlist/id/5WI_lCmBKE8.1/itag/96/source/yt_live_broadcast/requiressl/yes/ratebypass/yes/live/1/cmbypass/yes/gir/yes/dg_shard/5WI_lCmBKE8.1_96/hls_chunk_host/r13---sn-ab5l6n7r.googlevideo.com/playlist_type/DVR/pmbypass/yes/gcr/us/sver/3/fexp/902408,914052,915507,924222,930008,930802,932110,934030,940601,947362/upn/0uqYzJgejww/cpn/hLfQjMSPN8jz3x8P/ms/lv/mt/1403800987/mv/m/mws/yes/ip/##.###.###.###/ipbits/0/expire/1403823600/sparams/ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,gir,dg_shard,hls_chunk_host,playlist_type,pmbypass,gcr/signature/2471CA887336C14A43A283B4AC6DFF775DEA3D30.3E62D91AACE7D0817E733F826B068FAFC06CE5A2/key/dg_yt0/file/index.m3u8?start_seq=758

8a. Now press enter to go to the updated link and again It should download or it should open a file window to download it and press save. It will automatically be named for example “index(1).m3u8”

9a. Now open up the new playlist file in notepad++ and copy it to the very bottom of the original playlist file we opened at the very beginning of the show, and then go to file → save as. From there keep it index but change the format to .txt to create a text document and may I prefer saving it to an easy place to find it such as your desktop

10a Now we will need to use Mozilla Firefox and the addon DownThemAll! (https://addons.mozilla.org/en-US/firefo ... wnthemall/ ) now you’ll need to open up the download manager, and then right click and go down to advanced then from there select “import from file. “

11a. Now select the index.txt fie we just created and in the batch of links, right click and click “Select all” or Crtl-A and then right click again and click “Check selected items”. From there select where you want to save the files ***CREATE A NEW FOLDER AS YOU WILL CREATE OVER 1000 FILES*** to but DO use renaming mask, I have it setup on mine to downloads the files (it downloads based of the link list so its in order so it will be easier for joining the .ts files) My renaming mask (which I recommend is)

Code: Select all

 *inum**name*.*ext*

now let the downloads go, un the download manager you can use prefrences to download about 10 of them at a time (don’t worry the naming does not screw up, and this is the quickest way to do so) and let it finish.

12a. Now open TSSplitter.exe (http://www.videohelp.com/tools/TSSplitter) and click file in the menu bar and then click “open for joining”. In the newly opened Join TS Files window, press Add and it will open a file window. Go to where you saved each file from the live stream and left click your mouse and drag it all the way down the file list or you can click organize and from there select all (its quicker) and press open. It will give you the estimated size and there it’s destination will be (its always where the source files are) but you can rename it to your hearts content such as “Fullshow.ts”, I usually keep mine “001seg.Joined.ts”. ***NOW ALWAYS KNOW HOW LONG THE YOUTUBE STREAM WAS AS YOU CAN GET IT AT THE END OF THE BROADCAST FROM THE VIDEO SEEKER ON YOUTUBE, JUST INCASE THERE IS AN ISSUE WITH THE FILELENGHT BUT THAT WILL BE FIXED IN THE NEXT STEP ANYWAY***

13a. Now take your freshly joined .ts file and open it into DGAVCIndex (http://www.videohelp.com/tools/DGAVCDec) from there you can cut down to what you want from the broadcast using the seeker bar and if you go into the file you can use the arrow bars, to seek about 5 seconds back or forth into the file to really home in to where the broadcast starts (always start it a click before the broadcast to get the maximum length and to make sure nothing is cut off. Then where you desire to start the video press the Bracket on the very left next to the seeker bar to select where you want to start it. Then go the end and use the left seeker bar to go to where you want to cut it, (I normally just let the stream end when it normally ends, to keep that in.

14a. Now in DGAVCIndex, click file after you made your desired cuts, and from the dropdown list click “Save Project and Demux video” this will save into your folder where you opened the file from to begin with in DGAVCIndex and it will create 3 files. The first one, we can disregard it will be “[filename].dga” the Two we WILL need will be “[filename] PID 101 DELAY [Number]ms.aac” (That’s your audio) and “[filename].demuxed.264” [That’s your video]. There will be an new window opening up entitled “Information” that give you the video details such as the bitrate, frame rate and other various information. At the bottom of the screen you will see how much longer it goes and at the very bottom of the window where it says “Info: [something here]” It will say “Info: Finished! When the video is done and will also give you above that where it says “Remain” the length left before it finishes. Usually It takes for my system about 10 minutes for the shows to fully process though DVAVCIndex but it’s speedy considering we are re-encoding the file with out quality loss. After all this is done, you can close DGAVCIndex.

15a. Now with the freshly made files, open up TSMuxer (http://www.videohelp.com/tools/tsMuxeR) and press Add. It will open up a file window, direct it to where “[filename] PID 101 DELAY [Number]ms.aac” and “[filename].demuxed.264” are located, and click on one of them (does not matter which and press Open (NOTE: You’ll have to do it twice, one for the audio and one for the video). From there once you have them into TSMuxer, you will see a section near the bottom of the window called Output, may I recommend .TS or .M2TS file extension (They are really the same so it does not matter) but below where it give you the location of where the new file will be made with the file name you can change that by clicking browse, and that will open a new file window. You can then select where you want to save it and a new filename for the file. From There Click save and the window will close.

16a. Now go to the bottom of the window for TSMuxer where it has two buttons. One says “Save meta file” the other says “start muxing”. Click Start mixing, and it will open up a window says “muxing in progess” and will have a bar that and a notice on the upper right of the bar that says “Progess: #%”. When it is done it will play an Audible sound which can be loud, just a word of caution. From there, click Ok at the bottom middle of the window and it will close. There should not be an Error message, usually they just let you know something about the file but again, there should not be any since we demuxed the video and the audio that should fix the issues. So once you press OK, you can close you TSMuxer and go to where you saved the new video file and play it, and you can delete the files you made including all the seg.ts files to clean up space.

Enjoy!

[urlcenter]

It looks and seems complicated but the quality of your videos is first rate

[SunLover]

Excellent write up! THANKS for posting this!

I was initially looking at it while at work, so I'm limited to what I can do. I definitely need to play with this on my home system when I can download the other apps you use. The process makes sense. You're mainly downloading all the individual .ts files, then joining them together in correct time order.

I know what I will be doing this weekend!

[coasterghost]

Excellent write up! THANKS for posting this!

I was initially looking at it while at work, so I'm limited to what I can do. I definitely need to play with this on my home system when I can download the other apps you use. The process makes sense. You're mainly downloading all the individual .ts files, then joining them together in correct time order.

I know what I will be doing this weekend!

The youtube playlists links are a valid for about 10 hours or so.

[coasterghost]

Excellent write up! THANKS for posting this!

I was initially looking at it while at work, so I'm limited to what I can do. I definitely need to play with this on my home system when I can download the other apps you use. The process makes sense. You're mainly downloading all the individual .ts files, then joining them together in correct time order.

I know what I will be doing this weekend!

I forgot to add software I also use, but it really depends if you would need it, it's TSDoctor.