The iTV-Studio is a research and development project by the philosopher, scientist, and inventor Bob Doyle, who has been adapting consumer devices to reduce the cost of film and video tools for nearly fifty years to "help communities communicate."
iTV-Studio 0011 is a conversion of Bob's former NewMedia Lab, where studies of early digital video technology were conducted for the magazine. The lab is now a state-of-the-art multi-camera webcasting facility, from which Bob's online lectures on information philosophy are produced for live streaming.
Open the image below in a new tab to see the full panorama. The three rolling pedestal cameras at left are being installed at a news webcasting studio for the Harvard Crimson.
This iTV-Studio is a one-man operation. While lecturing, Bob switches between 7 Sony PTZ cameras and three media sources (two PCs and two Surface Pros that show his web pages, including YouTube videos, and online Skype guests), using the BMD ATEM switcher app on an iPad Pro.
Behind these are four DisplayLink screens extending his desktops. To his left on a pull-out drawer are the Sony PTZ camera controller, a laptop PC running his prompter software, an audio mixer, and the ATEM multiview screen on the table. The PTZ controller has multiple presets for the seven cameras. To his right on a pull-out drawer are three iPads running the VidiU app.
Each camera has a program monitor above and a teleprompter screen below so Bob can always maintain eye contact and see the studio clock.
Backhaul screens show live video on CCTV channel 9, Facebook, our program monitor, and YouTube
My first fifty lectures are linked from here. Turn on the amazing closed captions!
iTV-Studio 0007 (above and below) is a rolling Pelican case with a Blackmagic Design ATEM Production Studio switcher that supports eight 4K sources. It records to Apple Pro Res on a Hyperdeck Shuttle, and streams live to the Internet via a Teradek VidiU.
Two (or more) satellite iTV-Studios can be linked by cables, fiber optic, or wirelessly to provide coverage for major events such as sports.
iTV-Studio 0010 (not shown) is an addition of two camcorders, a PTZ camera, and two computers to Bob's personal desk upstairs to support his enhanced presentations at remote conferences. It is based on the new ATEM Mini switchers.
The iTV-Intracom provides headphones for program director, tech director, audio engineer, etc. The Intracom is a one-way intercom that sends the program audio (in left ear) and director's interrupt (in right ear) to all the camera operators' headphones;
The iTV-Prompter is the lightest and least expensive television prompter of its size (16" screen), with iTV-prompting software and iTV-Rundown program scheduling software with roll-in automation;
The iTV-TriCam Presentation System allows a single camera operator to manage three camera views - a tight shot on the speaker, a wide-angle view of a panel discussion, and a backward-looking or side view for audience questions.
An HDMI feed from the presenter's laptop produces high-resolution images of the speaker's slides to the iTV-Studio switcher.
The multiview screen shows the camera operator which camera is now on the program, which one is on preview, and what all other cameras are shooting.
When the room layout is wider than it is long, a Bi-Cam and Moni-Cam (each with multiview screens) let one camera operator run two cameras at the back of the room and another camera operator at the front and side cover reaction shots of the audience.
The iTV-Newsroom is a poor-man's studio pedestal camera, with prompter, program, and multiview monitors and a simple approach to tally signaling;
In front of the multiview monitor and above the teleprompter is a program monitor for the talent.
The iTV-Van
The iTV-Van is a small Outdoor Broadcast Truck that supports 16 or more cameras as far as 1000 feet away, to cover the largest sports venues. Fifteen cameras can be managed with as few as five camera operators using iTV-TriCam mounts (some cameras can be equipped with remote pan-tilt-zoom).
Four monitors in the iTV-Van show multiview images from satellite iTV-Studios hundreds of feet away.
The iTV-Van has multiple possible Internet connections, including wired Ethernet, fiber optic, wireless microwave bridge (150mbps), and multiple bonded cellular modems. When 5G cell phone service (150Mbps) becomes available, the iTV-Van will need only a single cellular modem.
A microwave dish antenna on the roof can connect by line of sight to an Ethernet connection in a building miles away, for streaming video to YouTube Live. A Yagi antenna amplifies cellular connections when no Ethernet is available.
The Scholastic Media Association of New England an award to Bob and his son Carter for the iTV-Van and the teaching theory behind our multi-camera recording of a play by the Harvard-Radcliffe Dramatic Society at the Loeb Center.
The iTV-Vanagon
The iTV-Vanagon is a conversion of a 1982 VW Vanagon to support a two-person podcasting studio.
Bill Wendel's Vanagon is becoming a mobile podcasting vehicle. (Our original iTV Van was a 16-camera outdoor broadcasting OB truck)
The Vanagon is powered by a marine deep discharge battery that we hope will operate for two hours or more (we will test). It has a 100ft extension cord for "shore power" when available.
It supports two podcasters seated inside and up to three outside using iPhones with wireless access to the van via three AppleTV devices. There is seating for a production assistant, a tech director, and a guest observer.
Like our ITV Studio 1, the Van has two DV camcorders mounted on Vanagon walls
The switcher is now an ATEM Mini Extreme ISO with 8 HDMI inputs (it was a Mini Pro ISO with 4 inputs)
HDMI mini cables from the Canon camcorders connect to ATEM Mini inputs on ATEM 1 and 2
Two Audio-Technica lavalier mics are input to camcorders. Optionally on two mic booms with pop screens
Smartphone input on ATEM 4, 5, 6 (wireless via AppleTV 1, 2, 3))
Wide-angle HDMI camera on ATEM 3
HP 14" laptop computer for host presentations is input on ATEM 8
MacBook 15" laptop computer for guest is input on ATEM 7
We have tested several devices that connect to the Internet via local cell towers, known as "hot spots."
Verizon Home 5G - $65/month (on You Tube)
ATT Internet Air - $20/month
Verizon Jetpack? (needs a line added to a phone data plan - $20/mo? - 876-5681)
ATT WiFi Router from NetGear (needs a line added to a phone data plan - $10/mo?).
We will also test ATT's Public WiFi "hot spots," which are free (Wi-Fi usage doesn't count against the monthly data plan).
Here is a short demo inside Bill Wendell's iTV-Vanagon.
Other iTV accessories include:
iTV-Program Audio Monitor and Intracom supports headphones for program director, tech director, audio engineer, etc. and a one-way intercom to all the camera operators.
iTV-MOS is a media object server to cue up and roll-in video files when prompted by the rundown schedule;
iTV-Multiview on-camera monitors allow each camera operator to see the other camera views, which camera is on Preview, which on Program.
iTV-Wireless Cameras and the Wireless Steadicam provide cable-free operation, including the iTV-CoachCam for on-field or on-floor interviews and the iTV-BasketCam for wide-angle views down on the basket.
iTV-Remote includes a single camera, a laptop with NLE, and a USB monitor with synchronized iTV-Rundown on location, for a producer-reporter team contributing a live package to the iTV-Studio.
iTV-Webcam connects remote guests via Skype or Google+.
iTV-Replay is a low-cost instant replay system. Camera operators can cue up the best shot from media in a camcorder.
iTV-ISO records camera videos to an array of SSD drives for post-production.
The iTV-Studio Back Story
In the early 1970's, Bob brought professional synchronous sound shooting and editing on magnetic film to consumer-quality Super 8 movie cameras. Film schools around the world used Super8 Sound equipment, including Bob's Harvard-Radcliffe Filmmaking Workshop.
Hollywood's American Cinematographer magazine devoted the November 1975 issue to "state-of-the-art" tools and techniques for Professional Super 8 developed by Super8 Sound, which continues today as Pro8mm in Burbank, CA.
Super8 Sound was a sustaining member of the Society of Motion Picture and Television Engineers and Bob was a full member of the SMPTE sound engineering committee, where he drafted the 1-pulse-per-frame sound synchronization standard. He has rejoined the SMPTE to assist with the development of live Internet television for the 21st century.
In the 1990's, he launched Quad Sound Studios at Harvard, funded the start-up of Videomaker Magazine, and was the "digital video guru" of NewMedia Magazine, where he covered the transition of video from analog to digital technology with a special interest in nonlinear desktop video editing (NLE).
Bob and his colleague Stuart Cody developed a technique for shooting with four Hi-8 camcorders, patched though a Panasonic WJ-MX50 4-input S-video switcher for live recording onto a fifth camcorder.
He built an RC time code to SMPTE time code converter so he could re-synchronize playback of the isolated Hi-8 tapes with an 8-track TASCAM audio recorder. Any part of the event could again be switched in post to improve where cuts were made.
He and Stuart described this in a cover story for Videomaker in 1993 titled "4 Cameras in Motion, Four Camera Editing." Today this is a trivial task for a nonlinear editor with multi cam editing that automatically synchronizes media files from camcorder SD cards.
By adding a Canopus ADVC-110, Apple QuickTime Broadcaster, and Apple's Darwin Server, Bob and colleague David Pearson experimented with an early version of what he called an iTV-Studio, four PTZ cameras streaming via UStream from Bob's lab over a decade ago.
The iTV-Studio Project in the 2010's
Bob's latest multi-camera development efforts put the core technology needed to produce a three- (to six-) camera television show streaming live to the Internet from a roll-about suitcase small enough to fit under an airline seat, weighing twenty-five pounds and consuming less than 60 watts of power.
Bob's current motto is "YouTube, but iTV." His new iTV-Studio tools are not needed for shows that are edited in post production. But iTV-Studio and its many accessories are the lowest-cost, easiest way to produce multi-camera live OTT television, for example sports broadcasting or news production.
Most OTT (over the top) or "TV Anywhere" streamed media is produced offline, uploaded to the Internet, and then played on demand in a nonlinear fashion. For this, you can use multiple camcorders that need not be connected. You simply remove their memory cards, import the files into a video editing program like Apple's industry-standard Final Cut Pro X. FCPX can synchronize the camera files based on their audio tracks. All the switching between cameras is done in post-production, with none of the pressure of a live event.
But much future television programming will be produced and viewed in linear "real time." Besides Livestream and Ustream, Google now offers us YouTube Live. Live internet television programs will be able to develop enormous world-wide audiences, not limited to today's local broadcast and cable outlets. Bob calls this iTV for internet television (with a lower-case italic i, not to be confused with Britain's ITV - Independent Television).
The amazing ATEM Television Studio has reduced expensive hardware to inexpensive software. It virtualizes electromechanical buttons, sliders, dials, faders, and numeric displays. It also virtualizes the many television monitors needed in the past in a single multiview display. It replaces hardware atoms with software bits, material with pure information.
The heart of the iTV-Studio is BMD's ATEM Television Studio, a 1U rackmount device with the state-of-the art electronics of a broadcast-quality HD switcher. It provides basic cuts, wipes, and dissolves, as well as upstream and downstream keys, but with none of the expensive mechanical buttons and faders of typical broadcast gear. All switching is done in software. You can add an electro-mechanical panel, but it increases switcher cost by about $5000.
Inside the iTV-Studio case is a 15" touchscreen laptop computer and a 16" USB monitor. The touchscreen laptop computer provides the switcher control surface, a media mixer with seven stereo input controls and a master output level control, a six-input camera-color-control interface, and a media still store. You can cut, wipe, or dissolve by touching the on-screen buttons or pressing the laptop keys.
The extended desktop on the 16" monitor lets you run other programs simultaneously, such as the playlist manager for a media object server (MOS) or a Skype session that allows remote guests in high resolution. One of the iTV-Studio HDMI inputs is connected to the HDMI output of the laptop computer.
The computer has three monitors that work together as a single extended desktop. The first is the laptop screen, the second the USB-powered monitor (these two have 1366x768 resolution), the third is one of the HDMI inputs to the iTV-Studio, with full HD 1920x1080 resolution. You can initiate a Skype or Google+ interview on the 16" monitor and then drag it to be full-screen on the iTV-Studio input (typically Camera 4 in a basic 3-camera iTV-Studio system).
Inside the lid of the iTV-Studio is a 20" HD monitor displaying the ATEM multiview screen with virtual program and preview monitors, six camera monitors, and two media still stores. Bob's original iTV-Studio in the 1990's was built on the Panasonic WJ-MX50 S-Video switcher, which cost $3500 in 1993 dollars. It had four 8" Sony CRT monitors for the cameras and two 12" monitors for preview and program. The monitors alone cost about $3000. Camcorders, then at $600, cost twice the latest low-end HD models. So the current iTV-Studio is less expensive than the original and a fraction of the weight and size.
The ATEM Television Studio incorporates H.264 hardware compression for recording program output to a hard drive connected to the laptop computer. It also includes an ATOMOS Ninja Star device that records Apple Pro Res to a Compact Fast card.
Unfortunately, the H.264 compressed stream cannot be sent to a streaming server. So the iTV-Studio includes an Internet broadcasting appliance for feeds to Livestream, Ustream, Twitch (now Amazon) or YouTube Live, so your show can be seen as it happens by as many viewers as you can attract.
The broadcasting appliance is a Teradek VidiU for a basic system built around ATEM Television Studio. For iTV-Studios built on Blackmagic Design's Production Studio 4K models, which do not record compressed video, we use either the Matrox Monarch HD (which records on SD cards and streams) or a combination of VidiU for streaming and BMD's Hyperdeck Shuttle, which can record on SSD drives in a number of formats (including uncompressed video and Apple ProRes 422).
Three to Six Full HD Camcorders.
To keep the basic iTV-Studio affordable, we equip it with three low-cost consumer camcorders. We find that they have excellent zoom lenses to cover large-venue events, as well as low-light capabilities that deliver good images in available light.
Every iTV-Studio is equipped with multiple SDI and HDMI outputs and inputs for
six camcorders,
or five camcorders and the laptop HDMI for a media server or for remote Skype input,
or four camcorders plus two laptops.
In this last case, the optional second laptop supports a second switcher control panel - for an audio engineer, for example. It also provides a separate interface and hard drive for serving video files (reducing CPU cycles on the first laptop), or a home for our iTV-Rundown program scheduler with iTV-Prompter software. We equip the second laptop with another USB-powered 16" monitor
In 2013, we took our second working prototype to Harvard University's Loeb Center where Harvard-Radcliffe Dramatic Club students were presenting a play called Conspiracy. Normally no photography or video is allowed in the Loeb. But the student director, Caleb Thompson '14, got special permission from the play's author, Loring Mandel to allow filming.
Carter and friend Andrew Ocejo tested the entire setup on our conference table.
Six videographers seated at various spots in the audience each had a Sony DV Handicam with a Lilliput monitor showing them a multiview of the others' cameras and who was on preview, who was on program. Since the director could not speak in the quiet auditorium, simple instructions were given in advance to the videographers, "If you are on preview or program, keep following your actor. If you are not, try to find a shot that is different from those two, and we might move you to preview for our next take."
Each camera person was thus a critical part of the creative team, not simply told by the director what to do!
Conspiracy DVD Cover
Conspiracy DVD Back Cover
The Conspiracy Film
When the Scholastic Media Association of New England learned of this innovative play recording with six videographers choosing their own shots, they invited us to their annual meeting at MIT to describe the concept and gave iTV an award.
The SMA also offered us booths at their 2015 Expo (which normally cost several thousand dollars) to show our iTV-Van next to outdoor broadcast (OB) trucks with single cameras that cost tens of thousands of dollars.
The ITV-Van
The Studio booth
Here is our brochure from the SMA Expo in 2015.
Also in 2015, we went to Cambridge Community Television's annual backyard event in November, where we set up multiple cameras connected to the old ITV Van
The ITV-Van at CCTV
ITV Studio Cameras
In 2018, Derek Xiao, then President of the Harvard Crimson, wrote Bob to say that he had reviewed Bob's emails to past Crimson presidents offering to build a multi-camera television studio and that the time had come to do it.
The iTV-Studio Project in the 2020's
Bob built various video and streaming capabilities for Lesley University. He gave the Digital Filmmaking department a Blackmagic Design ATEM Production Studio 4K and an ATEM Mini Pro ISO switcher in our custom Mini Case (with a 7" monitor, wifi access point, etc.).
He also gave the Digital Filmmaking department a $5000 grant to build low-cost multi-camera systems based on smartphones, with the idea that graduates could, start their own video production companies.
He invited staff of the Lesley Reading Recovery program to visit his library of reading research and gave them a $5000 grant to test an app for children learning to read. He also gave them two OBSBOT tracking cameras to support their online seminars.
Bob visited the St. John's chapel in Lesley's new South campus to discuss plans to convert it into a new Performance Center. He met with Matthew Nash, chairman of the Digital Filmmaking department, Charles Eaton, Senior Grants officer in Lesley's Leadership Annual Giving program, Joanne Kossuth, Chief Operations Officer, Information Technology, and Janet Steinmaier, Lesley University President.
They discussed a plan to create a video streaming production facility on a new floor built just inside the main entrance door. It would have an elevator so handicapped persons could participate.
This would obviously be a very expensive project and Bob recommended that he first build a small test streaming facility that would be mounted on the balcony railing of the chapel's organ seen at the right above.
Down on the floor would be three movable cameras on rolling tripods, communicating to the Lesley iTV-Studio on the balcony railing by HDMI transmitters.
Bob built a prototype for the "Lesley iTV Studio" with an ATEM Mini Extreme ISO, three cameras on tripod dollies with Mars 300 HDMI transmitters, and a Windows laptop with switching software..
Here is the six-foot wide prototype that would be mounted on the balcony railing, hidden above behind the three cameras on tripod dollies. The 8-input ATEM switcher is on the left. The laptop shows the ATEM Software Switching panel. The small monitors show program and the multiview of all cameras. And the tiny transmitters next to the monitors send that multiview back to the camera operators on the chapel floor, so the operators know which camera is currently streaming.
Sadly, Lesley staff never followed up. No one ever came to our lab to see this system.
Bob also offered Lesley the original iTV-Van, but ultimately they refused this donation, so the Van's video equipment was removed for other uses and the Ford Transit van was sold..
Bob also gave Lesley the podcasting equipment from our iTV-Studio 2. This was a success. A special room at Lesley became their student podcasting studio. Here is Matthew Nash inside Lesley's Radio and Podcasting Salon...