IRIS+ Best practices

overview iris+™ is a cloud based video analytics software as a service (saas), powered by cutting edge deep learning technology that enables unparalleled detection accuracy iris+ supports any fixed camera by connecting any rtsp/onvif video stream with the iris+ edge, a compact appliance with pre loaded software cameras can be ip cameras or analog cameras through a dvr that can output an rtsp/onvif stream this document describes best practices and considerations for selecting the cameras, viewing angles, onvif/rtsp resolutions and frame rates, and various aspects and scenarios of deployments to achieve the best analytics performance performing a site survey onvif/rtsp the integrator must perform a comprehensive site survey of the specific site on which the deployment of the iris+ video analytics system is planned, with the objective of identifying site parameters that may affect the ability to satisfy both project requirements and video analytics performance requirements the following items are documented in the site survey requirements detailed video analytics requirements, to be used as acceptance criteria for the deployed solution cameras cameras used (with their site layout) or planned to be used with video analytics viewing application of video and alerts 3rd party vms / psim / alarm monitoring applications will be used deployment architecture physical location of the recording, viewing, and monitoring clients and servers forensics / statistics if utilized, specifying operator locations, interfaces, data retrieval mechanism, retention time, and export format network infrastructure failover requirements lighting conditions environmental factors determining camera type this section describes how to select cameras for a site where the cameras are not yet installed or selected select from the following camera types fixed color camera this is the most common camera type used with video analytics there is a long list to choose from, ranging from vga to hd/fhd and higher resolution ip cameras iris+ can also work with analog/hd analog by retrieving a rtsp/onvif stream from a supporting dvr or analog video converter analytics performance can be increased by deploying the capabilities of wide dynamic range automatic switching between day and night thermal select a thermal camera in case of either limited or no lighting is available at night or you want the detection to cover large distances (over 80 meters) with a single camera it is not advisable to deploy thermal cameras with rules utilized to detect stationary targets such as stopped vehicle suspicious object asset protection forensic search based on color sensor and imaging type characteristics main usage compatibility with video analytics standard ccd / cmos commonly used color camera any common scenario very high thermal infra red radiation imaging (temperature based) complete darkness very long distances very high for perimeter protection application, some advanced scenarios not supported due to grayscale thermal image panoramic/ fisheye circular image – usually 180° / 360° wide panoramic coverage of an area with a single camera currently limited to top down ceiling mounted, supporting only people focused analytics such as moving in an area, crossing a line, and counting form factor type characteristics main usage compatibility with video analytics box/bullet the box shaped body requires a mounting arm or pole commonly used indoor / outdoor camera very high dome dome shape, usually with a built in enclosure ceiling, wall, and arm/pole mounting commonly used indoor / outdoor camera very high ptz pan tilt and zoom camera guard tour across multiple presets, tracking objects currently not supported unless positioned statically and never moved determining camera placement and fov based on analytics rules requirements, selected camera types, and recommended detection distances, you can next determine camera placement and required fields of view for each camera see also camera's viewing angle it is recommended to use cameras with viewing angles (horizontal fov) that are narrower than 110° fisheye cameras or cameras with a horizontal field of view that is wider than 110° may suffer from severe image warping that degrades analytics performance the camera should be properly leveled to the horizon plane (the horizon should not be tilted) optimizing fov to determine the ideal field of view (fov) for video analytics per camera, the following main criteria should be taken into consideration maximum target distance the maximum distance between the camera and the analyzed target, allowing reliable analytics determined by the camera’s viewing angle and the size of targets at maximum distance minimum target distance the minimum distance between the camera and the analyzed targets, allowing reliable analytics determined by the camera’s viewing angle and the size of targets at minimum distance target separation a camera’s field of view is considered to have good target separation if there are minimum occlusions caused by adjacent or close by objects, allowing a complete view of each target separately good target separation is key to the successful deployment of video analytics in scenes that are non sterile camera resolution irisity’s analytics supports resolutions of 320x240 (recommended only on thermal cameras) and higher including hd and megapixel resolution, although analytics accuracy will not be improved by resolutions higher than fhd each of the above criteria can be altered based on the following guidelines increase maximum target distance decrease minimum target distance improve target separation option 3 increase target magnification by using longer focal lengths decrease target magnification by using shorter focal lengths increase the tilt angle while striving for a 90 degree angle (camera looking straight down) decrease the camera’s tilt angle (note1) to extend the camera’s vertical viewing angle / maximum viewing distance increase the camera’s tilt angle (note1) to shorten the ‘dead zone’ use higher mounting heights to achieve top down viewing in wider areas across the field of view use greater mounting heights to produce lower sized targets which do not suppress the maximum allowed target size note zero degrees tilt angle refers to cameras mounted parallel to the ground 90 degree tilt angle refers to cameras mounted orthogonally to the ground (looking straight down) that are currently not supported conclusion for the long range field of view, use increased focal length and low tilt angle the minimum viewing distance can be compensated by adding a single camera at the top of the camera chain for the short range field of view, use short focal lengths, high tilt angle (as close to 90 degrees as possible), and higher mounting the higher the camera is, the higher the tilt angle required for non sterile scenes with the continuous presence of multiple people and/or vehicles, and for crowded environments, optimize target separation by using large tilt angles (90 degrees or as close as possible to it) and higher mounting height and tilt angles compensate for each other in this case adequate field of view (fov) and area of interest (aoi) position the camera so that it mostly occupies the aoi exclude irrelevant areas from the fov such as the sky and other non important regions try to keep the aoi centered in the fov avoid concealments and truncations of detected targets as much as possible the view of the aoi is best without physical obstacles such as trees, buildings, poles, signs, and any other static object that may obstruct the view of the target (person, vehicle, or static object) avoid vegetation, puddles, and running water in the aoi determining effective range the effective range for reliable analysis and detection is determined according to target size criteria which differ from one scenario to another the different scenarios are detailed in the below table size range criteria are based on the relative size of targets in the fov they are required for reliable analysis of people, vehicles, and static objects size range criteria are used across typical scenarios of camera mounting and scene learning ‘angled’ refers to cameras positioned with a tilt angle of 20° 50° (cameras tilted at an angle of 0° 20° or 50° 85° present views that are not optimal for analytics and are therefore not recommended) see camera placement principles docid\ sqv9vcojbkxhp4rh0tkna for more details regarding the camera placement design tool best practices for size range for people analysis scenario camera orientation minimum size criteria maximum size criteria example walking/running / loitering/crowding angled target height is greater than or equal to 36 pixels in length target’s longest side is less than 60% of the parallel image edge see reference below size range for vehicle analysis, as a % of the fov scenario camera orientation minimum size criteria maximum size criteria example moving target on a single lane road/street angled vehicle is viewed from its side target's longest side is greater than or equal to 36 pixels in length target’s longest side is less than 60% of the parallel image edge see reference 2 1 below static target on a single lane road/street angled vehicle is viewed from its side target's longest side is greater than or equal to 36 pixels in length target’s longest side is less than 60% of the parallel image edge see reference 2 1 below crowded scenarios, people or vehicles angled target's longest side is greater than or equal to 36 pixels in length ensure separation between different objects in view target’s longest side is less than 60% of the parallel image edge see reference 2 1 below moving target on a multi lane road/highway overhead/angled mounted on the gantry or angled camera on pole (6 meters or more) target's longest side is greater than or equal to 36 pixels in length ensure separation between different objects in view target’s longest side is less than 60% of the parallel image edge see reference 2 2 below static target on a multi lane road/highway overhead/angled mounted on the gantry or angled camera on a pole (6 meters or more) target's longest side is greater than or equal to 36 pixels in length ensure separation between different objects in view target’s longest side is less than 60% of the parallel image edge see reference 2 2 below moving target in an open area (parking lot, open yard) viewed from multiple directions including front and back with angled cameras target's longest side is greater than or equal to 36 pixels in length target’s longest side is less than 60% of the parallel image edge see reference 2 3 below static target in an open area (parking lot, open yard) viewed from multiple directions including front and back with angled cameras target's longest side is greater than or equal to 36 pixels in length target’s longest side is less than 60% of the parallel image edge see reference 2 3 below moving target on a single lane road / street angled vehicle is viewed from its side target's longest side is greater than or equal to 36 pixels in length target’s longest side is less than 60% of the parallel image edge see reference 2 1 below size range for static objects analysis, as a % of the fov scenario camera orientation minimum size criteria maximum size criteria example low activity scene good illumination non appearance of shadows, reflections, glare overhead/angled target's longest side is greater than or equal to 36 pixels in length target’s longest side is less than 60% of the parallel image edge see reference 3 1 below any indoor/outdoor scenario with good illumination overhead/angled target's longest side is greater than or equal to 36 pixels in length target’s longest side is less than 60% of the parallel image edge see reference 3 2 below references reference 1 1 walking/running/loitering/crowding with an angled camera a person’s longest side is approximately 36 pixels the size is within the allowed range for all person related video analysis functions reference 2 1 vehicle driving/stopping with an angled camera and side view the vehicle’s length is approximately 36 pixels the size of the vehicle is within the allowed range for moving/stopped vehicle analysis reference 2 2 vehicle driving/stopping on multiple lanes with an angled camera and side view the vehicle’s length is approximately 36 pixels the size of the vehicle is within the allowed range for moving/stopped vehicle analysis reference 2 3 vehicle driving/stopping on an open area with an angled camera and side view the vehicle’s length is approximately 36 pixels the size of the vehicle is within the allowed range for moving/stopped vehicle analysis reference 3 1 analysis of static objects/bags left behind the length is approximately 36 pixels the object is within the allowed size range for any static object analysis scenario implementing a lighting solution one of the most crucial points to take into consideration in an analytics deployment is the amount of light available during operational times a high quality image is critically important for successful video analytics deployments and so light considerations are key to ensuring high performance video analytics guidelines are provided below for best practices when deploying analytics under different lighting conditions for achieving the best possible performance please disregard this section when using thermal cameras comprehensive performance testing on site is achieved when you can identify the target you want to detect in all lighting conditions, 24/7 camera low light performance security cameras utilize several key elements to control the amount of incoming light and thus improve image quality in poor lighting conditions the main elements which impact the amount of incoming light are size of the sensor, iris/aperture, gain level, and shutter speed auto iris when properly implemented, auto iris maintains correct exposure levels and usually delivers moderate and gradual brightness changes so, if you need to operate video analytics across varying lighting conditions, choosing cameras that support auto iris is best auto shutter speed adjustment since the negative impact of slow shutter speed can always be expected when motion occurs, don’t rely exclusively on automatic shutter speed capabilities to properly compensate for video analytics under poor lighting conditions, since the capability to properly detect motion is essential automatic gain control (agc) and noise reduction filters (dnr) in practice, the combination of agc and dnr usually results in rapid contrast changes (aka ‘video breathing’) accompanied by a certain level of the remaining noise both are known as negative factors for video analytics as they manifest in rapid pixel changes often interpreted as nuisance motion, which increases the probability of false alarms recommendations avoid manual / fixed customization of the iris, shutter speed, and gain which aims to improve image quality at night, due to the negative impact of such adjustments during daylight hours favor day/night cameras that can adjust to nighttime conditions and light changes utilizing auto iris functionality, optionally combined with moderate agc and shutter speed control, over day/night cameras supporting agc with static or fixed iris control a good example of this technology is called p iris handling poor lighting with ir and thermal imaging after determining the best method to improve nighttime video quality, be aware of the rules of thumb when applying each here are the main ones considerations when deploying ir illumination there is a wide range of ir illuminators and price points in most cases, higher cost illuminators will provide better image quality, longer distances, and longer lifetime ir suffers from shallow depth of view, meaning that a single illuminator is mainly useful when used for either short range or longer ranges, but not both if you need to cover a range of more than 10 meters, you may need to combine short and mid range illuminators for the same camera every illuminator has a different beam width, allowing it to cover a particular width of the field of view wider angles allow shorter distances and vice versa make sure to choose an illuminator with an angle of view as close to the camera’s angle of view as possible use day night cameras containing an ir cut filter (which disables ir during daytime or in good lighting conditions) unless the camera is only used in dark scenes always focus the cameras at night when the ir is in action (ir cut filter is off), to bypass the known ir focus shift issue ir achieves greater distances indoors than outdoors ir range indicated by vendors is usually based on indoor scenes according to performance review indications found in the public domain, when deploying ir outdoors, expect to achieve detection distances that are half to a third of the distance indicated in the ir lighting product specification the illuminator should be mounted at least 1 meter below the camera considerations when deploying thermal cameras the main criteria of video quality for reliable analytics when utilizing thermal imaging is the contrast level differences between the detected target objects and their surrounding background higher contrast differences mean better quality while the level of contrast difference is directly impacted by the temperature difference between the target object and its surroundings, the actual figures vary in different environmental conditions (temperature, humidity, etc ) and distances as a result pay close attention to the vendor’s specifications regarding achievable distances and how they are impacted by environmental conditions test the camera performance in the field in varying conditions see also testing lighting performance some thermal cameras adopt various techniques to dynamically control their imaging sensitivity in varying conditions these methods sometimes result in rapid luminance and contrast changes since video analytics uses increased sensitivity when deployed with thermal cameras, it may lead to nuisance of false alarms caused by these rapid changes consult with the camera vendor to ensure that the camera allows some level of control or disabling of these functions lighting and camera placement additional considerations sufficient lighting level is the most common criterion to consider when deploying analytics there are, however, additional challenges for video analytics concerning the way that light and camera placement impact image quality here are the main issues to consider and how to resolve them issue wide dynamic range (wdr) scenes scenes containing a wide range of lighting conditions, including extremely bright and dark areas, will generate an image where the dark areas are completely dark, and the bright areas are saturated common scenarios involve indoor scenes with natural light coming from the outside (windows, entrance or garage doors, etc ), or scenes containing shadowed areas resolution use a camera with good wdr functionality or, alternatively, consider using a thermal camera issue direct light from vehicle headlights direct light from vehicle headlights combines an extreme wdr situation with low illumination, resulting in an extensive glare around the headlights and complete darkness around it resolution cameras used for video analytics should not be directed toward vehicle headlights avoid using the same camera for lpr and video analytics if headlights reflect blindingly on a road or wet surface low severity level select a camera with advanced wdr function or ir illumination combined with ir bandpass filter lens medium severity level use a slow shutter speed combined with ir illumination high severity level select thermal cameras issue direct sunlight direct sunlight ‘blinds’ the camera and generates ‘sun spots’ caused by reflected light, similar to the human eye when looking towards a strong light resolution exclude the sky from the camera’s field of view note the course of the sun during the day and position the camera so that it will not face the sun directly at dusk and dawn avoid placing the camera in front of windows, otherwise use curtains or plants to cover the blinds as much as possible issue shadows in the fov resolution video analytics can handle moderate shadows and reflections when dealing with shadows in a controlled, narrow angled scene such as in deployments of people counting or tailgating where the camera is placed above an entrance or close to a door, consider placing a carpet (preferably grey colored) on the floor to eliminate the shadows in extreme situations, use thermal cameras the table below summarizes the main lens and camera imaging functions and features to be considered and provides observations and recommendations for each function / feature observations and recommendations ultra high resolutions (above fhd) higher resolutions do not increase the detection range poorer image quality in low light conditions compared to fhd resolution improved image quality during daytime wdr scenes auto iris / manual iris auto iris is mandatory for outdoor locations with varying lighting conditions manual iris is a suitable alternative only for constant lighting conditions fixed iris should be avoided agc standalone agc functionality (which is not part of a combined module such as p iris or multi function low light capability) is usually a negative factor and should be avoided or disabled wdr highly recommended for wdr scenes during the daytime, if a high quality ‘true’ wdr is used (aka multi exposure wdr) advanced extreme low light techniques doesn’t overcome the need for external illumination in low light conditions under 5 lux, due to its disadvantages it may, however, eliminate the need for illumination in higher lux levels integrated ir meaningless in most scenarios except for in cases of extremely short ranges such as deployments of people counting or asset protection with an fov range of up to 4 5 meters ir cut filter mandatory when using ir illumination during daytime ir bandpass filter recommended when using ir and dealing with glare from ambient lights varifocal lens mandatory when the fov and aoi are not strictly determined at the stage of choosing the cameras, and when the fov and aoi may change in the future highly recommended in any other case since it allows fine tuning the fov interchangeable lens mandatory when needing to achieve extremely wide or extremely long (zoomed) fov beyond the capabilities of the default camera lens it’s highly recommended to choose cameras with the interchangeable lens when the fov and aoi are not strictly determined at the stage of choosing the cameras auto focus highly recommended as it significantly simplifies the focusing process, especially when the cameras are mounted high and/or in locations that are hard to access best practices for perimeter protection main objectives detect intruders approaching or loitering along the perimeter barrier (usually fence line or wall) detect intruders crossing the perimeter barrier relevant analytics rules person crossing a line person moving in an area person loitering camera mounting principles make sure that poles are stable in winds (if you mount cameras on poles) because pole movement decreases analytics performance standard electricity poles are insufficient as they sway excessively in wind calculate the ‘dead zone’ and detection range for the cameras being used, to determine the distance between cameras point the camera view along the perimeter so that movement of intruders is captured in an orthogonal direction relative to the camera when approaching the perimeter point the camera so that it views and protects the inner or outer area of the perimeter don’t attempt to point the camera so that it views both sides of the perimeter position the cameras so that each ‘dead zone’ is covered by the adjacent camera in the following example, the green colored cameras cover the blind spots of the opposite cameras located in the corners of the perimeter with this deployment method, there are no dead zones recommended camera spacing when protecting long perimeters, camera counts are a key parameter as they have a significant impact on the overall deployment cost to minimize the required number of cameras while not compromising on the probability of detection, follow the recommendations in section 8, optical camera recommendations, and section 9, thermal camera recommendations as a rule of thumb, cameras can often be spaced 100 200 meters or more apart depending on chosen resolution and camera field of view general recommendations camera mounting height and angle camera mounting height and angle mount cameras at least 3 5 meters / 11 5 feet from the ground cameras should be mounted with a certain downward tilt / mounting angle to ensure movement to and from the camera creates significant pixel changes when covering smaller areas, a mounting angle of 20 60 degrees is often a good choice for longer distances, adjust as necessary camera’s viewing angle cameras with wide viewing angles cover wide visible areas, however, they limit the analytics detection distance (see table 1 estimated detection ranges of optical cameras or table 2 estimated detection ranges with thermal cameras) it is recommended to use cameras with viewing angles (horizontal fov) that are narrower than 100° fisheye cameras or cameras with a horizontal field of view that is wider than 100° may suffer from image warping that degrades analytics performance optical camera recommendations video stream resolution and frame rate (fps) the recommended video stream frame rate is 8 – 12 fps note lowerframe rates will degrade analytics performance to meet the minimum required frame rate, the camera’s shutter speed should be at least 1/12 seconds higher frame rates consume additional computing resources but will not result in improved analytics performance the recommended video stream resolution is 720p – 1080p note using 1080p video stream resolution will result in improved detection (see the table below) but will consume more computing resources and network bandwidth using video stream resolution that is higher than 1080p will not necessarily result in improved analytics performance as megapixel cameras generally suffer from degraded low light pixel on target/ pixels per meter/ pixel per foot the system requires 36 pixels on target for most applications, in a non obscured view for a typical person of 1 80m/ 5 9ft height, that means 20px/m or 6 1px/ft for a typical vehicle of 5 8m/15 7ft length, that means 7 5px/m or 2 3px/ft note please also take into consideration that cameras with narrow fov are more sensitive to camera shake, which could impair detection performance additional recommendations the following environmental conditions may degrade analytics performance obscured targets camera shake fog inadequate lighting at the required detection distances thermal camera recommendations video stream resolution and frame rate (fps) the recommended minimal frame rate is 8fps note lower frame rates will degrade analytics performance higher frame rates consume additional computing resources but will in improved analytics performance the recommended resolution is vga (or above) pixel on target/ pixels per meter/ pixel per foot the system requires 36 pixels on target for most applications, in a non obscured view for a typical person of 1 80m/ 5 9ft height, that means 20px/m or 6 1px/ft for a typical vehicle of 5 8m/15 7ft length, that means 7 5px/m or 2 3px/ft note please also take into consideration that cameras with narrow fov are more sensitive to camera shake, which could impair detection performance thermal camera automatic gain control (agc) to minimize the ‘breathing’ effect created by thermal cameras’ agc, it is recommended to (1) use lenses with small focal lengths and (2) set the camera’s maximum gain to be in the range of 3 9db additional recommendations the following environmental conditions may degrade analytics performance obscured targets camera shake appendix a camera placement principles basic principles camera field and angle of view camera field of view is usually characterized by the combination of distance and scene dimensions (image width and height) figure 16 always right click images and "add caption" scene dimensions for a given distance are determined by the camera’s angle of view camera’s angle of view is determined by the focal length of the lens being used focal length the focal length of a lens is the distance between the optical center of the lens and the image sensor the longer the focal length, the more it “magnifies” the subject the diagram below illustrates the reciprocal relations between the focal length, angle of view, and image magnification (aka zoom level) figure 17 always right click images and "add caption" conclusions short focal length provides a wider angle of view, generating a wide (zoomed out) image long focal length provides a narrower angle of view, generating a narrow (zoomed in) image camera mounting options and impact on field of view angled mounting and tilt angle tilt angle is the angle between the camera’s lens position and the ground, as illustrated in the above diagram the relevant tilt angle range is between 0 to 90 degrees angled camera mounting refers to positioning a camera with a tilt angle less than 85 90 degrees in practice, angled cameras are typically positioned with a tilt angle varying between 10 to 40 degrees dead zone the area between the position of the camera and the closest viewing point is referred as the dead zone the camera is completely blind across the dead zone in other words, this area is excluded from the camera’s field of view detectable height and area this is the maximum height that can be detected at a particular distance from the camera the detectable height decreases when the distance from the camera is increased therefore, maximum viewing distance is determined according to the point where the detectable height is equal to the expected target height, and the detectable area, aka effective field of view, is the area between the closest viewing point (end of dead zone) and the maximum viewing distance correlation between tilt angle, dead zone and viewing distance for a given lens and camera height conclusion decreasing the tilt angle increases the viewing distance as well as the dead zone short range detection is typically achieved with increased tilt angle towards overhead mounting which eliminates the dead zone camera placement design tool to perform criteria verification, identify the scenarios relevant to your case and measure the size of target objects using one of the following methods use a camera design tool to determine the pixel per meter/feet ratio for a given camera at the minimum and maximum distances, and calculate the size criteria according to the relevant scenario one such recommended tool is the ip video system design tool which can be found at www jvsg com this type of tool allows users to input the various camera parameters (resolution, focal length, installation height, etc ) and place the cameras on top of a map or satellite image to view the resulting coverage areas for each camera if cameras are already placed, you can retrieve relevant footage and screenshots, with relevant target objects in the field of view, and calculate their relative size using an on screen pixel measurement tool a recommended tool is meazure which can be found at http //www cthing com/