This iTV-Studio is a one-man operation. While lecturing, Bob switches between 7 Sony PTZ cameras and three media sources (two PCs and two Surface Pros that show his web pages, including YouTube videos, and online Skype guests), using the BMD ATEM switcher app on an iPad Pro.
Behind these are four DisplayLink screens extending his desktops. To his left on a pull-out drawer are the Sony PTZ camera controller, a laptop PC running his prompter software, an audio mixer, and the ATEM multiview screen on the table. The PTZ controller has multiple presets for the seven cameras. To his right on a pull-out drawer are three iPads running the VidiU app.
Each camera has a program monitor above and a teleprompter screen below so Bob can always maintain eye contact and see the studio clock.
Backhaul screens show live video on CCTV channel 9, Facebook, our program monitor, and YouTube
My first fifty lectures are linked from here. Turn on the amazing closed captions!
The multiview screen shows the camera operator which camera is now on the program, which one is on preview, and what all other cameras are shooting.
When the room layout is wider than it is long, a Bi-Cam and Moni-Cam (each with multiview screens) let one camera operator run two cameras at the back of the room and another camera operator at the front and side cover reaction shots of the audience.
In front of the multiview monitor and above the teleprompter is a program monitor for the talent.
Four monitors in the iTV-Van show multiview images from satellite iTV-Studios hundreds of feet away.
The iTV-Van has multiple possible Internet connections, including wired Ethernet, fiber optic, wireless microwave bridge (150mbps), and multiple bonded cellular modems. When 5G cell phone service (150Mbps) becomes available, the iTV-Van will need only a single cellular modem.
A microwave dish antenna on the roof can connect by line of sight to an Ethernet connection in a building miles away, for streaming video to YouTube Live. A Yagi antenna amplifies cellular connections when no Ethernet is available.
The Scholastic Media Association of New England an award to Bob and his son Carter for the iTV-Van and the teaching theory behind our multi-camera recording of a play by the Harvard-Radcliffe Dramatic Society at the Loeb Center.
The Vanagon is powered by a marine deep discharge battery that we hope will operate for two hours or more (we will test). It has a 100ft extension cord for "shore power" when available.
It supports two podcasters seated inside and up to three outside using iPhones with wireless access to the van via three AppleTV devices. There is seating for a production assistant, a tech director, and a guest observer.
Like our ITV Studio 1, the Van has two DV camcorders mounted on Vanagon walls
The switcher is now an ATEM Mini Extreme ISO with 8 HDMI inputs (it was a Mini Pro ISO with 4 inputs)
HDMI mini cables from the Canon camcorders connect to ATEM Mini inputs on ATEM 1 and 2
Two Audio-Technica lavalier mics are input to camcorders. Optionally on two mic booms with pop screens
Smartphone input on ATEM 4, 5, 6 (wireless via AppleTV 1, 2, 3))
Wide-angle HDMI camera on ATEM 3
HP 14" laptop computer for host presentations is input on ATEM 8
MacBook 15" laptop computer for guest is input on ATEM 7
Here is a short demo inside the original iTV-Vanagon.
Here is the much simpler design for iTV_Vanagon 2
Two OBSBOT Tiny PTZ tracking cameras are mounted on the camera stands clamped to the table. They're connected through a USB hub to the laptop running OBS Studio. A 50 kWh power bank provides several hours of operation.
Two classic podcasting microphones are mounted on flexible arms with pop filters
A much simpler setup is for the podcasting host and guest to mount their smartphones on the two camera stands and individually connect to Google Meet for their podcast. No OBS scene switching is necessary.
In the early 1970's, Bob brought professional synchronous sound shooting and editing on magnetic film to consumer-quality Super 8 movie cameras. Film schools around the world used Super8 Sound equipment, including Bob's Harvard-Radcliffe Filmmaking Workshop.
Hollywood's
American Cinematographer magazine devoted the November 1975 issue to "state-of-the-art" tools and techniques for Professional Super 8 developed by Super8 Sound, which continues today as Pro8mm in Burbank, CA.
Super8 Sound was a sustaining member of the Society of Motion Picture and Television Engineers and Bob was a full member of the SMPTE sound engineering committee, where he drafted the 1-pulse-per-frame sound synchronization standard. He has rejoined the SMPTE to assist with the development of live Internet television for the 21st century.
In the 1980's, Bob designed and funded low-cost, three-color-camera television studios for Brown University's BTV and Harvard University's HRTV.
In the 1990's, he launched Quad Sound Studios at Harvard, funded the start-up of Videomaker Magazine, and was the "digital video guru" of NewMedia Magazine, where he covered the transition of video from analog to digital technology with a special interest in nonlinear desktop video editing (NLE).
Bob and his colleague Stuart Cody developed a technique for shooting with four Hi-8 camcorders, patched though a Panasonic WJ-MX50 4-input S-video switcher for live recording onto a fifth camcorder.
He built an RC time code to SMPTE time code converter so he could re-synchronize playback of the isolated Hi-8 tapes with an 8-track TASCAM audio recorder. Any part of the event could again be switched in post to improve where cuts were made.
He and Stuart described this in a cover story for Videomaker in 1993 titled
"4 Cameras in Motion, Four Camera Editing." Today this is a trivial task for a
nonlinear editor with multi cam editing that automatically synchronizes media
files from camcorder SD cards.
Bob's current motto is "YouTube, but iTV." His new iTV-Studio tools are not needed for shows that are edited in post production. But iTV-Studio and its many accessories are the lowest-cost, easiest way to produce multi-camera live OTT television, for example sports broadcasting or news production.
Most OTT (over the top) or "TV Anywhere" streamed media is produced offline, uploaded to the Internet, and then played on demand in a nonlinear fashion. For this, you can use multiple camcorders that need not be connected. You simply remove their memory cards, import the files into a video editing program like Apple's industry-standard Final Cut Pro X. FCPX can synchronize the camera files based on their audio tracks. All the switching between cameras is done in post-production, with none of the pressure of a live event.
But much future television programming will be produced and viewed in linear "real time." Besides Livestream and Ustream, Google now offers us YouTube Live. Live internet television programs will be able to develop enormous world-wide audiences, not limited to today's local broadcast and cable outlets. Bob calls this iTV for internet television (with a lower-case italic i, not to be confused with Britain's ITV - Independent Television).
Inside the iTV-Studio case is a 15" touchscreen laptop computer and a 16" USB monitor. The touchscreen laptop computer provides the switcher control surface, a media mixer with seven stereo input controls and a master output level control, a six-input camera-color-control interface, and a media still store. You can cut, wipe, or dissolve by touching the on-screen buttons or pressing the laptop keys.
The extended desktop on the 16" monitor lets you run other programs simultaneously, such as the playlist manager for a media object server (MOS) or a Skype session that allows remote guests in high resolution. One of the iTV-Studio HDMI inputs is connected to the HDMI output of the laptop computer.
The computer has three monitors that work together as a single extended desktop. The first is the laptop screen, the second the USB-powered monitor (these two have 1366x768 resolution), the third is one of the HDMI inputs to the iTV-Studio, with full HD 1920x1080 resolution. You can initiate a Skype or Google+ interview on the 16" monitor and then drag it to be full-screen on the iTV-Studio input (typically Camera 4 in a basic 3-camera iTV-Studio system).
Inside the lid of the iTV-Studio is a 20" HD monitor displaying the ATEM multiview screen with virtual program and preview monitors, six camera monitors, and two media still stores. Bob's original iTV-Studio in the 1990's was built on the Panasonic WJ-MX50 S-Video switcher, which cost $3500 in 1993 dollars. It had four 8" Sony CRT monitors for the cameras and two 12" monitors for preview and program. The monitors alone cost about $3000. Camcorders, then at $600, cost twice the latest low-end HD models. So the current iTV-Studio is less expensive than the original and a fraction of the weight and size.
The ATEM Television Studio incorporates H.264 hardware compression for recording program output to a hard drive connected to the laptop computer. It also includes an ATOMOS Ninja Star device that records Apple Pro Res to a Compact Fast card.
Unfortunately, the H.264 compressed stream cannot be sent to a streaming server. So the iTV-Studio includes an Internet broadcasting appliance for feeds to Livestream, Ustream, Twitch (now Amazon) or YouTube Live, so your show can be seen as it happens by as many viewers as you can attract.
The broadcasting appliance is a Teradek VidiU for a basic system built around ATEM Television Studio. For iTV-Studios built on Blackmagic Design's Production Studio 4K models, which do not record compressed video, we use either the Matrox Monarch HD (which records on SD cards and streams) or a combination of VidiU for streaming and BMD's Hyperdeck Shuttle, which can record on SSD drives in a number of formats (including uncompressed video and Apple ProRes 422).
To keep the basic iTV-Studio affordable, we equip it with three low-cost consumer camcorders. We find that they have excellent zoom lenses to cover large-venue events, as well as low-light capabilities that deliver good images in available light.
Every iTV-Studio is equipped with multiple SDI and HDMI outputs and inputs for
In this last case, the optional second laptop supports a second switcher control panel - for an audio engineer, for example. It also provides a separate interface and hard drive for serving video files (reducing CPU cycles on the first laptop), or a home for our iTV-Rundown program scheduler with iTV-Prompter software. We equip the second laptop with another USB-powered 16" monitor
- six camcorders,
- or five camcorders and the laptop HDMI for a media server or for remote Skype input,
- or four camcorders plus two laptops.
In 2013, Bob and grandson Carter took our second working prototype ITV-Studio 0002 to Harvard University's Loeb Center where Harvard-Radcliffe Dramatic Club students were presenting a play called Conspiracy. Normally no photography or video is allowed in the Loeb. But the student director, Caleb Thompson '14, got special permission from the play's author, Loring Mandel to allow filming, and the Harvard Professor of English who oversees the Loeb Center approved the exceptional recording.
Carter Doyle (right) and friend Andrew Ocejo tested the entire recording setup on our conference table.
Six videographers seated at various spots in the audience each had a Sony DV Handicam with a Lilliput monitor showing them a multiview of the others' cameras and who was on preview, who was on program. Since the director could not speak in the quiet auditorium, simple instructions were given in advance to the videographers, "If you are on preview or program, keep following your actor. If you are not, try to find a shot that is different from those two, and we might move you to preview for our next take."
Each camera person was thus a critical part of the creative team, not simply told by the director what to do!
The recording of the play was saved as an mp4 file that is available on the web.. An opening title sequence was animated by Bob and burned to a DVD.
| The ITV-Van | The Studio booth |
|---|---|
|
|
Also in 2015, we went to Cambridge Community Television's annual backyard event in November, where we set up multiple cameras connected to the old ITV Van
| The ITV-Van at CCTV | CCTV Studio Cameras |
|---|---|
|
This would obviously be a very expensive project and Bob recommended that he first build a small test streaming facility that would be mounted on the balcony railing of the chapel's organ seen at the right above.
Down on the floor would be three movable cameras on rolling tripods, communicating to the Lesley iTV-Studio on the balcony railing by HDMI transmitters.
Bob built a prototype for the "Lesley iTV Studio" with an ATEM Mini Extreme ISO, three cameras on tripod dollies with Mars 300 HDMI transmitters, and a Windows laptop with switching software..
Here is the six-foot wide prototype that would be mounted on the balcony railing, hidden above behind the three cameras on tripod dollies. The 8-input ATEM switcher is on the left. The laptop shows the ATEM Software Switching panel. The small monitors show program and the multiview of all cameras. And the tiny transmitters next to the monitors send that multiview back to the camera operators on the chapel floor, so the operators know which camera is currently streaming.
Sadly, Lesley staff never followed up. No one ever came to our lab to see this system.
Bob also offered Lesley the original iTV-Van, but ultimately they refused this donation, so the Van's video equipment was removed for other uses and the Ford Transit van was sold..
Bob also gave Lesley the podcasting equipment from our iTV-Studio 2. This was a success. A special room at Lesley became their student podcasting studio. Here is Matthew Nash inside Lesley's Radio and Podcasting Salon...