Spliced Audio/Video Browsing Data URL Tutorial
It’s data URL media conduits that make …
- browsing for local files off the client operating system environment … and …
- a genericized “guise” of web server media files … and …
- client File API blob or canvas content media representations
… a point of commonality, and as far as we are concerned, we are always looking to these days, whenever we can, data size permitting, to do away with static web server references, open to so many mixed content and privilege issues.
Perhaps, that is the major reason, these days, we’ve taken more and more to hashtag based means of communication via “a” “mailto:” (email) or “sms:” (SMS) links.
Today proved to us that that, albeit most flexible of all, clientside hashtag approach has its data limitations, that PHP serverside form method=POST does better at, as far as accomodating large amounts of data.
And so, yesterday, with our Splicing Audio or Video inhouse web application, turning more towards data URLs to solve issues, we started the day …
- trying hashtag clientside based navigations … but ran into data size issues, so …
- introduced into our Splicing Audio or Video inhouse web application, for the first time, PHP serverside involvement …
… that made things start working for us better getting the synchronized play of our user entered audio or video media items performing better.
And so, further to yesterday’s Spliced Audio/Video Data URL Tutorial we added browsing for local media files as a new option for user input, by calling …
- our changed tutorial_to_animated_gif.php PHP animated GIF creator helper web application … hosted in a new iframe element to help collect local file media file(s) … itself calling …
- the changed client_browsing.htm client side local file browsing HTML and Javascript inhouse helper … to help …
- totally new “first draft” PHP “guise of” our Splicing Audio or Video inhouse web application (mainly adding $_POST[] navigation knowledge to the HTML template to work off) … that being …
- our changed splice_audio.htm live run
- entering a File as a relative URL to the RJM Programming domain document root …
- entering a File as a fully formed audio or video data URL
- audio file … and less user friendly is …
- text that gets turned into speech via Google Translate (and user induced Text to Speech functionality), but needs your button presses
- video
- image … and background image for webpage
- discrete … or “Optional”
- synchronized … or “Overlay”
- audio file … and less user friendly is …
- text that gets turned into speech via Google Translate (and user induced Text to Speech functionality), but needs your button presses
- video
- image … and background image for webpage
- discrete … or “Optional”
- synchronized … or “Overlay”
- audio file … and less user friendly is …
- text that gets turned into speech via Google Translate (and user induced Text to Speech functionality), but needs your button presses
- The first was a simulation of those Sydney train public announcements where the timbre of the voice differs a bit between when they say “Platform” and the “6” (or whatever platform it is) that follows. This is pretty obviously computer audio “bits” strung together … and wanted to get somewhere towards that capability.
- The second one relates to presentation ideas following up on that “onmouseover” Siri audio enhanced presentation we did at Apple iOS Siri Audio Commentary Tutorial. Well, we think we can do something related to that here, and we’ve prepared this
cakeaudio presentation here, for us, in advance … really, there’s no need for thanks. - The third concerns our eternal media file synchronization quests here at this blog that you may find of interest we hope, here.
- Audio with Background then Form for another, perhaps
- Audio with Background and Form showing the whole time
- Audio with no Background then Form for another, perhaps
- Just Audio
Previous relevant Spliced Audio/Video Data URL Tutorial is shown below.
Spliced Audio/Video Data URL Tutorial
We’re revisiting the Spliced Media web application talked about at Spliced Audio/Video Overlay Position Tutorial to shore up some input conduits …
… and there is still browsing for local files we’d like to add to that list, but on another day.
We started considering this work to help the user to fill out a real media duration value that can help with the synchronized playing of the media.
We found that the onloadedmetadata statically defined …
<div id=divanaudio><audio id='anaudio' onload=alere(event); onloadedmetadata=ahere(event); style=display:none;><source id=sanaudio src=""></source></audio></div>
<div id=divanvideo><video id='anvideo' onload=vlere(event); onloadedmetadata=vhere(event); style=display:none;><source id=sanvideo src=""></source></video></div>
<iframe name=myif onload='checkdu(this);' id=myif src=/HTMLCSS/do_away_with_the_boring_bits.html style=display:none;></iframe>
<form id=myifform method=POST style=display:none; target=myif action=/HTMLCSS/do_away_with_the_boring_bits.php>
<input type=hidden name=url id=myifurl value=''></input><input type=hidden name=durto id=myifdurto value=''></input><input type=hidden name=justfgcdu id=myifjustfgcdu value=''></input><input type=submit id=myifb value=Submit style=display:none;></input></form>
… in an audio or video element hosted by a reworked div hosting element was the way to go …
function doinput(sio) {
var ij=0;
if (sio.value.indexOf('data:audio/') == 0) {
if (sio.value.indexOf(';base64,') != -1) {
durtoid='end' + sio.id.replace('audio','');
document.getElementById('sel' + sio.id.replace('audio','')).value='Audio';
document.getElementById('divanaudio').innerHTML=divanaudio.replace('>source ', '<source type=audio/' + sio.value.split('data:audio/')[1].split(',')[0].split(';')[0] + ' ').replace(' src=""', ' src="' + sio.value + '"').replace('none','NONE');
document.getElementById('myif').src='/HTMLCSS/do_away_with_the_boring_bits.php?rand=' + encodeURIComponent(sio.value.split(';base64,')[0] + ';base64,');
document.getElementById('myifurl').value=sio.value;
document.getElementById('myifdurto').value=durtoid;
document.getElementById('myifjustfgcdu').value=sio.value.split(';base64,')[0] + ';base64,';
setTimeout(function(){
document.getElementById('myifb').click();
}, 2000);
}
} else if (sio.value.indexOf('data:video/') == 0) {
if (sio.value.indexOf(';base64,') != -1) {
durtoid='end' + sio.id.replace('audio','');
document.getElementById('sel' + sio.id.replace('audio','')).value='Video';
document.getElementById('divanvideo').innerHTML=divanaudio.replace('<source ', '<source type=video/' + sio.value.split('data:video/')[1].split(',')[0].split(';')[0] + ' ').replace(' src=""', ' src="' + sio.value + '"').replace('none','NONE');
document.getElementById('myif').src='/HTMLCSS/do_away_with_the_boring_bits.php?rand=' + encodeURIComponent(sio.value.split(';base64,')[0] + ';base64,');
document.getElementById('myifurl').value=sio.value;
document.getElementById('myifdurto').value=durtoid;
document.getElementById('myifjustfgcdu').value=sio.value.split(';base64,')[0] + ';base64,';
setTimeout(function(){
document.getElementById('myifb').click();
}, 2000);
}
} else if (sio.value.indexOf('data:image/') == 0) {
durtoid='end' + sio.id.replace('audio','');
} else if ((' ' + sio.value.replace(/\.$/g,'')).slice(-5).indexOf('.') != -1) {
for (ij=0; ij<mexts.length; ij++) {
if ((sio.value + '~').indexOf(mexts[ij] + '~') != -1) {
durtoid='end' + sio.id.replace('audio','');
document.getElementById('sel' + sio.id.replace('audio','')).value=mtypes[ij].split('/')[0].substring(0,1).toUpperCase() + mtypes[ij].split('/')[0].substring(1).toLowerCase();
switch (mtypes[ij].split('/')[0]) {
case "audio":
document.getElementById('myif').src='/HTMLCSS/do_away_with_the_boring_bits.php?url=' + encodeURIComponent(sio.value) + '&durto=end' + sio.id.replace('audio','') + '&justfgcdu=' + encodeURIComponent('data:' + mtypes[ij] + ';base64,');
break;
case "video":
document.getElementById('myif').src='/HTMLCSS/do_away_with_the_boring_bits.php?url=' + encodeURIComponent(sio.value) + '&durto=end' + sio.id.replace('audio','') + '&justfgcdu=' + encodeURIComponent('data:' + mtypes[ij] + ';base64,');
break;
default:
break;
}
}
}
}
audiofiles[eval(-1 + eval(sio.id.replace('audio','')))]=sio.value;
}
function checkdu(iois) {
if (iois.src.indexOf('/do_away_with_the_boring_bits.') != -1 && iois.src.indexOf('/do_away_with_the_boring_bits.htm') == -1) {
var twaconto = (iois.contentWindow || iois.contentDocument);
if (twaconto != null) {
if (twaconto.document) { twaconto = twaconto.document; }
if (twaconto.body.innerHTML.replace(/^\/tmp/g, 'data:audio').indexOf('data:audio/') != -1) {
//alert(twaconto.body.innerHTML);
//document.getElementById('sanaudio').src=twaconto.body.innerHTML;
//alert(divanaudio + ' ... ' + twaconto.body.innerHTML);
if (twaconto.body.innerHTML.indexOf('data:audio/') != -1) {
document.getElementById('divanaudio').innerHTML=divanaudio.replace('<source ', '<source type=audio/' + twaconto.body.innerHTML.split('data:audio/')[1].split(',')[0].split(';')[0] + ' ').replace(' src=""', ' src="' + twaconto.body.innerHTML + '"').replace('none','NONE');
} else {
var pref=1;
if (document.getElementById('audio' + pref).value.indexOf('data:') == -1) {
while (document.getElementById('audio' + pref).value.indexOf('data:') == -1) {
pref++;
}
}
while (document.getElementById('audio' + pref).value.indexOf('data:') == -1) {
pref++;
}
document.getElementById('audio' + pref).value=twaconto.body.innerHTML;
iois.src='/HTMLCSS/do_away_with_the_boring_bits.php?rand=';
}
//alert(document.getElementById('divanaudio').innerHTML);
} else if (twaconto.body.innerHTML.indexOf('data:video/') != -1) {
//document.getElementById('sanvideo').src=twaconto.body.innerHTML;
//alert(divanvideo + ' ... ' + twaconto.body.innerHTML);
document.getElementById('divanvideo').innerHTML=divanvideo.replace('<source ', '<source type=video/' + twaconto.body.innerHTML.split('data:video/')[1].split(',')[0].split(';')[0] + ' ').replace(' src=""', ' src="' + twaconto.body.innerHTML + '"').replace('none','NONE');
//alert(document.getElementById('divanvideo').innerHTML);
}
//alert(twaconto.body.innerHTML);
}
}
}
function ahere(evt) {
if (document.getElementById('sanaudio').src.trim() != '') {
document.getElementById(durtoid).value=Math.ceil(eval('' + document.getElementById('anaudio').duration));
//alert('audio here');
//alert('audio here ' + document.getElementById('anaudio').duration);
}
}
function alere(evt) {
if (document.getElementById('sanaudio').src.trim() != '') {
document.getElementById(durtoid).value=Math.ceil(eval('' + document.getElementById('anaudio').duration));
//alert('audio Here');
}
}
function vhere(evt) {
if (document.getElementById('sanvideo').src.trim() != '') {
document.getElementById(durtoid).value=Math.ceil(eval('' + document.getElementById('anvideo').duration));
//alert('video here');
//alert('video here ' + document.getElementById('anvideo').duration);
}
}
function vlere(evt) {
if (document.getElementById('sanvideo').src.trim() != '') {
document.getElementById(durtoid).value=Math.ceil(eval('' + document.getElementById('anvideo').duration));
//alert('video Here');
}
}
This works if you can fill in the src attribute of the relevant subelement source element with a suitable data URL (we used the changed do_away_with_the_boring_bits.php helping PHP to derive). From there, in that event logic an [element].duration is there to help fill out those end of play textboxes in a more automated fashion for the user that wants to use this new functionality, as they fill out the Spliced Media form presented.
Previous relevant Spliced Audio/Video Overlay Position Tutorial is shown below.
Spliced Audio/Video Overlay Position Tutorial
Today we’ve written a third draft of an HTML and Javascript web application that splices up to nine bits of audio or video or image input together, building on the previous Spliced Audio/Video/Image Overlay Tutorial as shown below, here, and that can take any of the forms …
… for either of the modes of use, that being …
… all like yesterday, but this time we allow you to “seek” or position yourself within the audio and/or video media. We still all “fit” this into GET parameter usage. Are you thinking we are a tad lazy with this approach? Well, perhaps a little, but it also means you can do this job just using clientside HTML and Javascript, without having to involve any serverside code like PHP, and in this day and age, people are much keener on this “just clientside” or “just client looking, plus, perhaps, Javascript serverside code” (ala Node.js) or perhaps “Javascript clientside client code, plus Ajax methodologies”. In any case, it does simplify design to not have to involve a serverside language like PHP … but please don’t think we do not encourage you to learn a serverside language like PHP.
While we are at it here, we continue to think about the mobile device unfriendliness with our current web application, it being, these days, that the setting of the autoplay property for a media object is frowned upon regarding these mobile devices … for reasons of “runaway” unknown charge issues as you can read at this useful link … thanks … and where they quote from Apple …
“Apple has made the decision to disable the automatic playing of video on iOS devices, through both script and attribute implementations.
In Safari, on iOS (for all devices, including iPad), where the user may be on a cellular network and be charged per data unit, preload and auto-play are disabled. No data is loaded until the user initiates it.” – Apple documentation.
A link we’d like to thank regarding the new “seek” or media positioning functionality is this one … thanks.
Also, today, for that sense of symmetry, we start to create the Audio objects from now on using …
document.createElement("AUDIO");
… as this acts the same as new Audio() to the best of our testing.
For your own testing purposes, if you know of some media URLs to try, please feel free to try the “overlay” of media ideas inherent in today’s splice_audio.htm live run. For today’s cake “prepared before the program” we’ve again channelled the GoToMeeting Primer Tutorial which had separate audio (albeit very short … sorry … but you get the gist) and video … well, below, you can click on the image to hear the presentation with audio and video synchronized, but only seconds 23 through to 47 of the video should play, and the presentation ending with the image below …
We think, though, that we will be back regarding this interesting topic, and hope we can improve mobile device functionality.
Previous relevant Spliced Audio/Video/Image Overlay Tutorial is shown below.
Spliced Audio/Video/Image Overlay Tutorial
Today we’ve written a second draft of an HTML and Javascript web application that splices up to nine bits of audio or video or image input together, building on the previous Splicing Audio Primer Tutorial as shown below, here, and that can take any of the forms …
… for either of the modes of use, that being …
The major new change here, apart from the ability to play two media files at once in our synchronized (or “overlayed”) way, is the additional functionality for Video, and we proceeded thinking there’d be an Javascript DOM OOPy method like … var xv = new Video(); … to allow for this, but found out from this useful link … thanks … that an alternative approach for Video object creation, on the fly, is …
var xv = document.createElement("VIDEO");
… curiously. And it took us a while to tweak to the idea that to have a “display home” for the video on the webpage we needed to …
document.body.appendChild(xv);
… which means you need to take care of any HTML form data already filled in, that isn’t that form’s default, when you effectively “refresh” the webpage like this. Essentially though, media on the fly is a modern approach possible fairly easily with just clientside code. Cute, huh?!
Of course, what we still miss here, is the upload from a local place onto the web server, here at RJM Programming, capability, which we may consider in future, and that some of those other synchronization of media themed blog postings of the past, which you may want to read more, for this type of approach.
In the meantime, if you know of some media URLs to try, please feel free to try the “overlay” of media ideas inherent in today’s splice_audio.htm live run. We’ve thought of this one. Do you remember how the GoToMeeting Primer Tutorial had separate audio (albeit very short … sorry … but you get the gist) and video … well, below, you can click on the image to hear the presentation with audio and video synchronized, and the presentation ending with the image below …
We think, though, that we will be back regarding this interesting topic.
Previous relevant Splicing Audio Primer Tutorial is shown below.
Splicing Audio Primer Tutorial
Today we’ve written a first draft of an HTML and Javascript web application that splices up to nine bits of audio input together that can take either of the forms …
Do you remember, perhaps, when we did a series of blog posts regarding the YouTube API, that finished, so far, with YouTube API Iframe Synchronicity Resizing Tutorial? Well, a lot of what we do today is doing similar sorts of functionalities but just for Audio objects in HTML5. For help on this we’d like to thank this great link. So rather than have HTML audio elements in our HTML, as we first shaped to do, we’ve taken the great advice from this link, and gone all Javascript DOM OOPy on the task, to splice audio media together.
There were three thought patterns going on here for me.
Also of interest over time has been the Google Translate Text to Speech functionality that used to be very open, and we now only use around here in an interactive “user clicks” way … but we still use it, because it is very useful, so, thanks. But trying to get this method working for “Platform” and “6” without a yawning gap in between ruins the spontaneity and fun somehow, but there’s nothing stopping you making your own audio files yourself as we did in that Siri tutorial called Apple iOS Siri Audio Commentary Tutorial and take the HTML and Javascript code you could call splice_audio.html from today, and go and make your own web application? Now, is there? Huh?
Try a live run or perhaps some more Siri cakes?!
If this was interesting you may be interested in this too.
If this was interesting you may be interested in this too.
If this was interesting you may be interested in this too.
If this was interesting you may be interested in this too.
If this was interesting you may be interested in this too.
