Differences between revisions 2 and 16 (spanning 14 versions)
Revision 2 as of 2009-11-12 20:30:40
Size: 6994
Comment: Tekst for studentoppgaver.
Revision 16 as of 2009-11-15 20:26:36
Size: 8135
Editor: ErikVold
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
This project is hoping to unite traditional TV-medium with the Internet. TV has always been sort of «analog» and one way communication. There is always an editor that will decide the content of the channel, and the viewers have rarely been able to participate, or contribute to the actual broadcasts. Today we have editing programs on a PC, and we can record, edit and publish right out of the box. Since all people can publish on the web, then why should they not be able to publish their content on the TV - medium?
Line 3: Line 4:
This project is hoping to unite traditional TV-medium with the
internet. TV has always been sort of «analoge» , and one way
comunication. There is always a editor that will decide the content of
the channle, and the viewers have never beed able to participate, or
contribute to the actual broadcasts. Today we have editing programs on
a PC, and we can record, edit and publish right out of the box.
Since all people can record edit and publish on the web, then why
shuldnt they be able to publish their content on the TV - medium.
Right now there are few solutions, and those that exists are proprietary and based on expensive hardware.
Line 12: Line 6:
Rigth now there are few solutions, and those that exists are
properiatory, and based on expencive hardware....
Why not make an open TV channel based on open and free software?
Line 15: Line 8:
So how about a computer with a SDI card, and VLC.... TV should not be controlled by few. It should be possible to make a broadcast system available to all.

How about a computer with a SDI card, and an open media player controlled by the web?
Line 18: Line 13:
== Backend ==
This is where all the media is stored, it's a computer with multiple SAN devices over fibre channel.
Line 19: Line 16:
== Backend == When a person is uploading a video it can be uploaded directly to this server.
Line 21: Line 18:
This is where all the media is stored, it's a computer with multiply
SAN devices over fiber channel.
The file server has a watchfolder for the transcoder. After transcoding, meta data will be updated in the scheduler showing that the media is available for broadcast. The transcoded file is stored in a broadcast safe format on the backend. The backend is the hub storing files for other systems. Transcoded files for web is also available on the backend.
Line 24: Line 20:
When a person is uploading a video, it can be uploaded direct to this
server.
This system is already created, as well as its central database.
Line 27: Line 22:
The File server then has a watchfolder to the transcoder solution for
easy transcoding, and meta data veryfing to the sched uler. this is
for easy file acsess to files from other systems.
All the communication will be documented in the servers API.
Line 31: Line 24:
This system is already created, as well as its sentral database. == Scheduler ==
This is a system that generates a playlist from a web based user interface. This system has a stand alone database and is a "controller" for the open playout system. It has a web based interface for video registration, and a playlist configurator. A web based scheduler is already implemented in silverlight and can be used as a model for a new scheduler based on open standards.
Line 33: Line 27:
All the comunication will be documented in the servers API.

== Sceduler ==

This is a system that generaters a playlist, from a web based user
interface This platform has a standalone database and is "controller"
for the open playout system. It has a web based interface for video
registration, and playlist configurator.

=== "system flow" ===

Acsess the web site, and registrer a video. Upload the video to
backend from this site, and publish the content to the monthely
scheduler for playout. you can then also access the video in various
formats online for viewing purpeses, as a comunity channel
=== "intended workflow" ===
Access the web site and register a video. Publish the content on the schedule (calender) for playout. On the registered video it should be possible to upload the videofile to a predefined folder on the backend. If this is done prior to the scheduled time of broadcast, the video will be aired. If the video is not uploaded in time, the user and the administrator should be warned by mail.
Line 50: Line 31:
Transcoding solution needs to get "what ever format" from Backen and transcode it for broadcast and web (in open standard formats). On a communitysite you can then access the video for validating what you schedule or add comments to vidoes that has been uploaded by other users. Ideally the trascoder should be network based so you can connect new modules to accelerate transcoding.
Line 51: Line 33:
Transocding solution needs to get "what ever format" from Backend, for
trasncoding to Broadcast, web and open standard formats. Hopefully it
can also be network based, so you can connect new modules to
accelerate transcoding

=== "flow" ===

The system gets a file in a folder, takes the file and transcodes,
renames and moves it according to the scheduler database system. if a
new computer on the network presents itself to the trascoder as a
module, it will add it to the system for accelerated transcoding.
=== "intended workflow" ===
The system gets a file in a folder, takes the file and transcodes, renames and moves it according to the schedulers database. if a new computer on the network presents itself to the transcoder as a module, it will add it to the system for accelerated transcoding.
Line 64: Line 37:
The player is the final output of the system, totally controlled by the scheduling system that tells what to play when. The player should also be able to pass trough live rtsp/http streams on scheduled time slots.
Line 65: Line 39:
The player is the final output of the system, totaly controled by the
schedluresystem, that tells what to play when. The player should aslo
be able to pass trough live rtsp/http streams for Live broadcasting.

=== "player" ===

Gets playlist and time from Scheduler and copyes the files from
backend for direct playout. If the sceduled item is a live source, the
feed will be played as a normal item.
=== "intended workflow" ===
Fetch the playlist from the schedulers database, copy the files needed for the day from backend and play the videos on the SDI output according to the schedule. If the scheduled item is a live source, the feed will be played as a normal item.
Line 76: Line 43:
Frikanalen today have working implementations of all these modules, created by the company Never.no using Microsoft technology.
Line 77: Line 45:
Today we have all of theese modules working, the company Never.no
created it, based on microsoft thecnology.
The backend is a Windows 2003 server with SAN storage and a tape robot attached. The upload system is based on FileFlow, a third party application. The systems API is SOAP based and uses a MS SQL database to store meta-data.
Line 80: Line 47:
The backend is a full windows 2003 server with a tape robot attached,
it also has a uploading system on it called Fileflow. The systems API
is based on SOAP witch connects to a Microsoft SQL database.
The scheduler is implemented using Microsoft Silverlight. It presents the content of the video database and allows the user to schedule content two weeks in advance.
Line 84: Line 49:
The Scheduler, and admin interface is based on Microsoft Silverlight
thecnology. This is where you have the video database, that connects
to the scheduler and you can add content to the scheduler ,
The transcoding system is split in two, one to generate DV-AVI files used for TV broadcasting, and one to generate Windows Media and Ogg Theora files for web publishing. The first uses Adobe Aftereffects, and the second uses Microsoft Expression Encoder 3. Both are quite slow single unit systems which do not handle parallell processing.
Line 88: Line 51:
The transcoding system for broadcast is based on Adobe Aftereffects
(including format conversion). We also use Microsoft Expression
Encoder 3 for transcoding to web formats. Both are single unit system
that is quite slow and not optimized for parallell processing.
The playout system is based on a Harris video server with a CG-module attached (Character Generator).
Line 93: Line 53:
The playout system is based on a Harris video playout with a CGI
module attached.
Since Frikanalen have a fully operational backend and frontend system, why should we need to replace them? This project is not aimed at replacing the system we have, but to add modules making this democratic tool available to all. With open standards on the web-based scheduling, more effecient transcoding and cheap implementations of playout we hope to spread the concept of public access TV.
Line 96: Line 55:
Since we have a fully operational background services, then we dont
need to change it, says some... We want all users of the big
internett to be included into this «party» and that´s why we creating
this project.
The project will be creating 3 modules that can be attached to the existing system, talking to the backend system over the SOAP API, and be based on free and open standards. It will also replace the playout unit with a standard PC / MAC with a SDI graphics card.
Line 101: Line 57:
The project will be creation of 3 modules that can be attached to this
system, talking to this system over the SOAP API, and be a «none»
Silverlight thecnology, it will also replace the playout unit with a
standard PC / MAC with a SDI computer card.

The system needs also to be standalone units, for integration with
other systems, so use open formats, talk over open formats then all
systems can comunicate,
The modules need to be standalone units, not to waste time while other modules are in development. Free and open formats must be used and code must be well documented assuring all modules to work together in the final integration.
Line 111: Line 60:
The playout module is our highest priority. The idea is to fetch information from the schedule and play out the videoes at the scheduled time. When there are «holes» in the shedule betweeen videos, «What's next» type of poster with an animated background should be shown. For larger gaps, a set of filler videos should be automatically scheduled.
Line 112: Line 62:
The playout module is our first priority. The idéa is to lissen on the
commands from the scheduler, and play out the videoes at the correct
time from the sceduler. When there are none videos to be played. We
want «show info» to be shown on the channel, creating a «Whats next»
type of poster, with a animated background.
Qualifications:
Line 118: Line 64:
Qualifications:  * basic knowledge of VLC, or a player with similar capabillites
 * XML parsing knowledge
 * general codec knowledge
Line 120: Line 68:
 * basic knowlage of VLC, or a player with similar capebilitys
 * reverse enginering existing scheduler system, for getting the playlist
 * Image magic
 * general codec knowlage

its preffered with Some openGL / openCL skills is also good to know to
comunucate with the Video play out card.
It is an advantage to have some OpenGL / OpenCL skills to be able to get the SDI graphics card working.
Line 129: Line 71:
This system is the main control system, which connects the Player with the videos, and the Database. it´s design need to be «stand alone» with the possibility to talk to all systems, even the expensive Harris Video server.
Line 130: Line 73:
This system is the main controll system, witch connects the Player
with the videos, and the Database. it´s design need to be
«standalone» with the posibility to talk to all systems, even the
expensive Harris Video server.
This system needs access to the all ready existing Backend system and Schedule system, it needs to be a «clone» of the existing system. but with the possibilities to also work as a stand alone system
Line 135: Line 75:
This system needs acsess to the all ready existing Backend system and
Scedule system, it needs to be a «clone» of the existing system. but
with the posibillytis to also work as a standalone system
First off, today this is a «Slave» scheduler for the Silverlight scheduler, where you,get the information on what to play from.
Line 139: Line 77:
First off, today this is a «Slave» sceduler for the Silverlight
scheduler, where you,get the information on what to play from.

Then, aftter the scheduler can be a slave to the master scheduler, the
project moves on to be a stand alone scheduler, with upload
posibilytis, to backend, and controll of the transcoding system.
Then, after the scheduler can be a slave to the master scheduler, the project moves on to be a stand alone scheduler, with upload possibilities, to backend, and control of the transcoding system.
Line 150: Line 83:
 * Basic video knowlage / VLC / Transcoding  * Basic video knowledge / VLC / Transcoding
= Project three - transcoder =
To get «Whatever file type» to known formats, as .dv for the playout system, Ogg Theora for the web system, and the possibility for other formats, as MP4, X264, MPEG 2...
Line 152: Line 87:
= Project three - transcoder = There are a lot of open encoders out there, you have the FFMPEG project, which a lot is based on, you have Handbrake, and not to mention VLC.
Line 154: Line 89:
To get «Whatever filetype» to known formats, as .dv for the playout
system, Ogg Theora for the web system, and the posibilyty for other
formats, as MP4, X264, MPEG 2...
This project aims to get a working transcoder to talk to the Scheduler system, and the Backend system.
Line 158: Line 91:
There are a lot of open encoders out there, you have te FFMPEG
project, witch a lot is based on, you have Handbrake, and not to
menton VLC.
When a user uploads the file, the Scheduler database system tells the transcoder, «now the file is ready» the transcoder takes the file and transcodes it to various formats as specified in the scheduler system.
Line 162: Line 93:
This project aims to get a working transcoder to talk to the Scheduler
system, and the Backend system.

When a user uploads the file, the Scheduler database system tells the
transcoder, «now the file is ready» the transcoder takes the file and
transcodes it to various formats as spessyfied in the sheduler system.

If posible, the transcoder system shuld be able to swap feeld orders,
normalise the sound volume, check 4*3 VS 16*9, also multiply computers
rendering farm.
If possible, the transcoder system should be able to swap field orders, normalise the sound volume, check 4*3 VS 16*9, also multiply computers rendering farm.
Line 175: Line 97:
 * Codec knowlage
 * Transcoding knowlage
 * Video knowlage
 * Pearl , Mysql and PHP
 * Network and TCP/UDP knowlage
 * Codec knowledge
 * Transcoding knowledge
 * Video knowledge
 * Perl, MySQL/PostgreSQL and PHP
 * Network and TCP/UDP knowledge

Welcome to this projects PDF file.

This project is hoping to unite traditional TV-medium with the Internet. TV has always been sort of «analog» and one way communication. There is always an editor that will decide the content of the channel, and the viewers have rarely been able to participate, or contribute to the actual broadcasts. Today we have editing programs on a PC, and we can record, edit and publish right out of the box. Since all people can publish on the web, then why should they not be able to publish their content on the TV - medium?

Right now there are few solutions, and those that exists are proprietary and based on expensive hardware.

Why not make an open TV channel based on open and free software?

TV should not be controlled by few. It should be possible to make a broadcast system available to all.

How about a computer with a SDI card, and an open media player controlled by the web?

Module based

Backend

This is where all the media is stored, it's a computer with multiple SAN devices over fibre channel.

When a person is uploading a video it can be uploaded directly to this server.

The file server has a watchfolder for the transcoder. After transcoding, meta data will be updated in the scheduler showing that the media is available for broadcast. The transcoded file is stored in a broadcast safe format on the backend. The backend is the hub storing files for other systems. Transcoded files for web is also available on the backend.

This system is already created, as well as its central database.

All the communication will be documented in the servers API.

Scheduler

This is a system that generates a playlist from a web based user interface. This system has a stand alone database and is a "controller" for the open playout system. It has a web based interface for video registration, and a playlist configurator. A web based scheduler is already implemented in silverlight and can be used as a model for a new scheduler based on open standards.

"intended workflow"

Access the web site and register a video. Publish the content on the schedule (calender) for playout. On the registered video it should be possible to upload the videofile to a predefined folder on the backend. If this is done prior to the scheduled time of broadcast, the video will be aired. If the video is not uploaded in time, the user and the administrator should be warned by mail.

Transcoder

Transcoding solution needs to get "what ever format" from Backen and transcode it for broadcast and web (in open standard formats). On a communitysite you can then access the video for validating what you schedule or add comments to vidoes that has been uploaded by other users. Ideally the trascoder should be network based so you can connect new modules to accelerate transcoding.

"intended workflow"

The system gets a file in a folder, takes the file and transcodes, renames and moves it according to the schedulers database. if a new computer on the network presents itself to the transcoder as a module, it will add it to the system for accelerated transcoding.

Player

The player is the final output of the system, totally controlled by the scheduling system that tells what to play when. The player should also be able to pass trough live rtsp/http streams on scheduled time slots.

"intended workflow"

Fetch the playlist from the schedulers database, copy the files needed for the day from backend and play the videos on the SDI output according to the schedule. If the scheduled item is a live source, the feed will be played as a normal item.

Page 4

Frikanalen today have working implementations of all these modules, created by the company Never.no using Microsoft technology.

The backend is a Windows 2003 server with SAN storage and a tape robot attached. The upload system is based on FileFlow, a third party application. The systems API is SOAP based and uses a MS SQL database to store meta-data.

The scheduler is implemented using Microsoft Silverlight. It presents the content of the video database and allows the user to schedule content two weeks in advance.

The transcoding system is split in two, one to generate DV-AVI files used for TV broadcasting, and one to generate Windows Media and Ogg Theora files for web publishing. The first uses Adobe Aftereffects, and the second uses Microsoft Expression Encoder 3. Both are quite slow single unit systems which do not handle parallell processing.

The playout system is based on a Harris video server with a CG-module attached (Character Generator).

Since Frikanalen have a fully operational backend and frontend system, why should we need to replace them? This project is not aimed at replacing the system we have, but to add modules making this democratic tool available to all. With open standards on the web-based scheduling, more effecient transcoding and cheap implementations of playout we hope to spread the concept of public access TV.

The project will be creating 3 modules that can be attached to the existing system, talking to the backend system over the SOAP API, and be based on free and open standards. It will also replace the playout unit with a standard PC / MAC with a SDI graphics card.

The modules need to be standalone units, not to waste time while other modules are in development. Free and open formats must be used and code must be well documented assuring all modules to work together in the final integration.

Project one - playout

The playout module is our highest priority. The idea is to fetch information from the schedule and play out the videoes at the scheduled time. When there are «holes» in the shedule betweeen videos, «What's next» type of poster with an animated background should be shown. For larger gaps, a set of filler videos should be automatically scheduled.

Qualifications:

  • basic knowledge of VLC, or a player with similar capabillites
  • XML parsing knowledge
  • general codec knowledge

It is an advantage to have some OpenGL / OpenCL skills to be able to get the SDI graphics card working.

Project two - scheduler

This system is the main control system, which connects the Player with the videos, and the Database. it´s design need to be «stand alone» with the possibility to talk to all systems, even the expensive Harris Video server.

This system needs access to the all ready existing Backend system and Schedule system, it needs to be a «clone» of the existing system. but with the possibilities to also work as a stand alone system

First off, today this is a «Slave» scheduler for the Silverlight scheduler, where you,get the information on what to play from.

Then, after the scheduler can be a slave to the master scheduler, the project moves on to be a stand alone scheduler, with upload possibilities, to backend, and control of the transcoding system.

Qualifications:

  • Ajax and general web programing, XML, PHP
  • Mysql programing, as a main database
  • Basic video knowledge / VLC / Transcoding

Project three - transcoder

To get «Whatever file type» to known formats, as .dv for the playout system, Ogg Theora for the web system, and the possibility for other formats, as MP4, X264, MPEG 2...

There are a lot of open encoders out there, you have the FFMPEG project, which a lot is based on, you have Handbrake, and not to mention VLC.

This project aims to get a working transcoder to talk to the Scheduler system, and the Backend system.

When a user uploads the file, the Scheduler database system tells the transcoder, «now the file is ready» the transcoder takes the file and transcodes it to various formats as specified in the scheduler system.

If possible, the transcoder system should be able to swap field orders, normalise the sound volume, check 4*3 VS 16*9, also multiply computers rendering farm.

Qualifications:

  • Codec knowledge
  • Transcoding knowledge
  • Video knowledge
  • Perl, MySQL/PostgreSQL and PHP
  • Network and TCP/UDP knowledge

grupper/video/frikanalen/studentoppgaver (last edited 2015-11-29 21:27:04 by localhost)