Monitor with virtual production set

Camera and Display Plugin

Design, visualize and refine your virtual production shots.

*Supported Unreal Engine versions are different on each plugin version. Please check the release note.

The challenges of virtual production

The “Camera and Display Plugin” is an Unreal Engine plugin for in-camera VFX shooting used in virtual production. Many cinematographers worry about image quality when compared to green-screen shooting. Visualizing the on-set image in advance is hard and expensive. Reproducing that image during the shoot is even harder. Our plugin lets you design the picture you need for virtual production with Sony cameras and system cameras*. It consists of a “Virtual Camera Actor” for use in the previsualization process, and an “On-set Camera Component” and “Camera Control Panel” for use in the on-set (shooting) process.

*VENICE 2, VENICE, BURANO, ILME-FR7, HDC-F5500, HDC-5500V, HDC-5500, HDC-3500V, and HDC-3500. Please refer to the Operations Manual for the detailed functionality of these individual models.

This is a transparent image

More precise pre-visualization

Let your Virtual Art Department create pre-visualizations that reflect the reality of your upcoming shoot in an LED volume. Share them with your on-set team for a smoother shoot and less issues while being in the on-set stage.

Note: A Camera and Display Plugin License is required to delete the watermark.

This is a transparent image

Better on-set shooting

Transfer the defined parameters to your physical VENICE camera, preserving your creative vision. Monitor and control your VENICE settings via a simple GUI on Unreal Engine. Benefit from real-time moiré alerts for the shoot.

Note: A Camera and Display Plugin License is required to use on-set functions.

On-set Camera Component

This is an Unreal Engine component that adds functions necessary for virtual production shooting by attaching them to the standard Unreal Engine Cine Camera actor used for in-camera VFX.

It works with the Camera Control Panel (VENICE cameras only), which allows you to set the camera via network, and the separately sold application Color Calibrator, to provide a function that corrects the color characteristics of Sony cameras and LED displays to reproduce the intended colors. The On-set Camera Component enables easy and effective color workflow during the on-set (shooting) process. It also supports LED grading, allowing you to adjust the brightness and color of HDR image output to LED displays.

In addition, the moiré warning function allows you to predict the occurrence of moiré that is difficult to see with the naked eye in the shooting environment.

Live Camera Sync

The feature allows you to synchronize camera and lens settings between the actual VENICE, the on-set Cine Camera actor, and Virtual VENICE. This allows you to automatically adjust the size of the inner frustum output to the LED display according to the imager mode settings of the actual VENICE, or apply the camera lens settings to the on-set Cine Camera actor as an alternative to the lens encoder and control box.

Note: A Camera and Display Plugin License is required.

A Virtual Camera Actor showing HDC-F5500, HDC-5500/3500, ILME-FR7, BURANO and VENICE / VENICE 2

Virtual Camera Actor

The Virtual Camera Actor reproduces the characteristics of Sony cameras, including the look, by performing a signal processing equivalent to that of actual Sony cameras. In the previsualization process, it is possible to create images in the same way as if a Sony camera were used. The camera settings also correspond to everything from imager modes to aperture, ND Filter settings and precise color adjustments. Maintain a consistent color pipeline, from original art direction to the LED volume and what you see and record on your VENICE camera. For VENICE cameras, you can easily reproduce the image creation in the previsualization process on the actual VENICE by transferring the Virtual VENICE settings to the actual VENICE using the Camera Control Panel in the on-set (shooting) process.

Virtual Production Toolset: Tutorial Video
See how the Sony Virtual Production Tool Set functions, its installation method for your PC environment, and how to use both the Camera and Display Plugin, and Color Calibrator.

Moiré Alert

By combining technical information about the sensor optical information of cameras and LED pitch information, our plugin can automatically predict when aliasing is most likely and alert you during both Pre-Visualization and On-set shooting. Get the most accurate simulation with the Crystal LED series, including the new VERONA. It can even detect moiré patterns that are not visible to the naked eye.

Note: Moiré Alert predicts areas where moiré may occur in advance, but it does not guarantee prevention of moiré under all conditions.

A Moiré Alert with colored spaces showing the alert in operation.
Camera Setting Transfer with Camera and Display Plugin

Camera Setting Transfer

Import and export settings from your Virtual VENICE with configuration files. Save parameter settings in our Camera and Display Plugin, then transfer them to your physical VENICE camera via the camera control panel UI. Easily reproduce pre-visualized content on your VENICE cameras. User 3D LUT used in Virtual VENICE can be easily applied to real VENICE.

Support for the Unreal VCam application

Enables Virtual Scouting using an iPad, controlling camera angle, Base ISO, Imager modes, Lens Simulation, etc. with the Unreal VCam application. Some Cine EI settings (ISO/EI, ND, WB, etc.) can also be adjusted from the iPad.

Note: Virtual HDC cameras are not supported. A Camera and Display Plugin License is required to delete the watermark.

iPad being used for Virtual Scouting with a desktop monitor in the background.

On-Screen display

Enable the display of status information and frame lines in the Viewport of Virtual VENICE / Virtual BURANO / Virtual FR7.

On-screen display for the Camera and Display plugin

PL mount lens simulation

Virtual VENICE / VENICE 2 / BURANO / HDC-F5500 can emulate lens distortion and vignetting of some PL mount lenses, allowing you to understand the lens characteristics.

Supported lens models: Angenieux (Super35 25-250 mm), Canon (CN-E 20-50 mm, CN-E 45-135 mm, CN8×15 IAS S, CN8×15 IAS S (1.5x Extender)), Fujifilm (Premista 19-45 mm T2.9, Premista 28-100 mm T2.9, Premista 80-250 mm T2.9-3.5, XK 20-120 mm T3.5, ZK 14-35 mm T2.9, ZK 19-90 mm T2.9, ZK 25-300 mm T3.5-3.85, ZK 85-300 mm T2.9-4.0), Zeiss (Supreme Prime series, Compact Prime CP.3 series)

On-screen display for the Camera and Display Plugin

Flexible licensing terms

The Camera and Display Plugin is a free application but installing a license will further enhance the pre-visualization and on-set shooting capabilities and reduce work time. You can get a monthly [LCN-CDPM1] or yearly [LCN-CDPY1] license through your preferred Sony authorized reseller or online (in certain countries).

Paid License (Camera and Display Plugin License )

*Free with Watermark (WM). Editor display doesn’t have WM.

VENICE
VENICE 2
BURANOFR7HDC-F5500
HDC-5500
HDC-3500
Pre-VisDelete WatermarkPaid LicensePaid LicensePaid LicensePaid License
Pre-VisVirtual CamerasFreeFree*Free*Free*
Pre-VisMoiré Alert (Pre-Vis)Free*Free*Free*Free*
Pre-VisEpic Unreal VCam appFree*Free*Free*-
Pre-VisOn-Screen DisplayFreeFreeFree-
Pre-VisPL Lens SimulationFree*Free*-Free* (HDC-F5500 only)
Pre-VisCamera Config Save/LoadFreeFreeFreeFree
On-Set ShootingRemote Control PanelFree---
On-Set ShootingCamera Setting TransferPaid License---
On-Set ShootingLive Camera SyncPaid License---
On-Set ShootingMoiré Alert (On-Set)Paid LicensePaid LicensePaid LicensePaid License
On-Set ShootingnDisplay Setting, Color Calibration, LED GradingPaid LicensePaid LicensePaid LicensePaid License