1. Introduction to the Project

1.1 Introduction to technical achievements

The project team has utilized years of research and development experience to design a series of depth camera products with characteristics such as high resolution, high precision, ultra-wide angle, and low distortion, which are suitable for different application scenarios and requirements. The products adopt advanced optical system design and high-performance image processing algorithms, effectively improving the quality and stability of depth images while reducing costs and power consumption. The products can provide high-quality images and depth data in a variety of scenes, and provide high-quality visual solutions for intelligent manufacturing, autonomous driving, intelligent robots and other fields. It conforms to the growth trend of the current stereoscopic perception market, conforms to the national and industrial development strategies and policy guidance, and is innovative, progressiveness and practical.

1.2 Technical analysis and advantages

Wide-angle precision optical design and depth measurement technology: using optical design to reduce imaging distortion and achieving a wider field of view and long-distance high-precision depth measurement.

Adaptive environment perception algorithm for all working conditions: real-time adaptation to various harsh environments, ensuring optimal perception performance in harsh conditions such as rain, snow, haze, and complex working conditions.

High-speed self-developed processing architecture: it is equipped with an efficient processing architecture, breaking through international chip blockages, ensuring product sustainability, suitable for real-time target detection and tracking, and intelligent driving perception.

Multidimensional optical data integration technology: collecting multiple optical data to achieve more accurate and comprehensive target detection, recognition, and tracking, reducing imaging blur and distortion.

1.3 Main products and applications of technical achievements

(1) Main products

Monocular stereo camera JD3D-L1020: real-time monitoring of the size, surface, and other aspects of the main factory’s component products through high-precision image measurement and defect detection technology.

Monocular camera stereo camera JD3D-L1040: through highly sensitive image recognition and stereo positioning technology, real-time recognition of factory ground signs, obstacles, goods, etc., while coordinating information with the factory's scheduling system, achieving visual guidance for robots or AGVs.

Vehicle-grade binocular stereo camera JD3D-L2050: Based on multiple sets of stereo cameras capturing panoramic images, the high-precision panoramic bird’s-eye view images are formed. Through wireless communication with satellite terminals, future autonomous vehicle intelligent collaborative positioning perception is achieved.

Roadside security monitoring binocular stereo camera JD3D-L2100: through high-definition image acquisition and 3D reconstruction technology, real-time monitoring of road operation status, and data exchange and analysis with cloud data centers, achieving intelligent network connection of roads.

(2) Main application areas of technological achievements

Commercial market: collaborating with partners to explore commercial markets, such as advertising, film and television, media, automotive, and other fields.

Government and public service market: providing the customized photography technology support for government departments and public service institutions such as transportation, security, medical and other fields.

1.4 Technical achievement commercialization and market promotion

1.4.1 Stage of technological achievements

They have entered the pilot stage.

1.4.2 Technical achievement marketing promotion plan

Utilize online and offline channels for extensive promotion such as social media, professional photography forums, outdoor advertising, etc., to enhance product awareness and reputation.

Provide personalized product customization services based on the needs of different markets to meet the actual needs of various customer groups.

Establish good cooperative relationships with various channel merchants and agents, expand sales networks, and improve market coverage.

Cooperate with professional media to enhance the recognition of products in the professional field through evaluations, special reports, and other forms.

1.5 Technical team

The team has gathered outstanding talents from the School of Instrument Science and Electrical Engineering at Jilin University, with the research directions covering cutting-edge fields such as artificial intelligence, image processing, stereo vision, and new camera development. Relying on some advanced technology platforms such as the Key Laboratory of Earth Information Exploration Instruments of the Ministry of Education and the National Engineering Technology Research Center, it undertakes the design and development of stereo cameras based on environmental perception.

2. Market Potential Analysis

Market space: With the gradual upgrading of two-dimensional perception to three-dimensional perception, the three-dimensional perception market is in the early stage of rapid growth in scale. Stereoscopic perception performs are better in multiple aspects such as resolution and target recognition, and have the lower costs. However, it is still constrained by the working principle of calculating depth information through triangulation. Once the angle between the baseline or projection receiving module is offset, it will bring errors in depth calculation, and low yield will inevitably lead to high costs and expensive prices. At the same time, there are also some problems such as low performance in harsh weather conditions, weak long-range detection capabilities, and significant distortion in wide field imaging, which further promote the development of the stereoscopic perception market. The 3D imaging and sensing market is driven by the development and research and development of sensors, transmitters, optical components, and module technologies. Currently, 3D imaging and sensing is moving towards diversification and intelligence, and in the future, various fields will work together to increase their volume. According to a global 3D imaging and sensing market research report released by Yole, a French market research and strategic consulting firm, the 3D visual perception market is mainly composed of consumer electronics, industrial, medical, automotive, and consumer electronics sectors. By 2025, its sub-sectors will have accounted for 54%, 11%, 2%, 8%, and 25% of the 3D perception market, respectively, with the higher growth rates in the consumer electronics and automotive fields. In the future, with the development and penetration of technologies such as in-pixel hybrid stacking and the gradual shift of LiDAR light sources from near-infrared (NIR) to shortwave infrared (SWIR), more and more emerging industries will enter the 3D visual perception market, such as 3D printing equipment, humanoid robots, virtual reality mixing, etc. It is expected that the global 3D visual perception market size will have reached 15 billion US dollars by 2025.

Competition: The main companies currently engaged in research and development of related technologies and products include some technology giants such as Microsoft and Intel as well as companies such as Infineon, IMI, and Orbbec. Microsoft is one of the earliest companies to launch consumer grade 3D visual sensors. After years of development, it has launched structured light and iToF technology 3D visual sensors for market sales, driving the progress of 3D visual perception technology. Intel has launched multiple products for developers, robots, and other application scenarios. Infineon, IMI, and Orbbec have also launched their own self-developed 3D visual sensor products.

3. Financing Needs and Financing Purposes

The project is planned to raise 5 million yuan, which is intended to be used for the salaries of technical employees and the labor wages of external part-time personnel; product development consumables during the pilot process.

4. Analysis of Technical Achievements and Benefits

4.1 Economic benefits

The market value of the technical achievements of the project is 50 million yuan.

4.2 Social benefits

The new generation of multimodal stereo perception cameras can achieve fast and accurate recognition and tracking of targets, which helps to improve public safety, prevent and combat criminal behavior, and ensure social stability. It can conduct real-time monitoring of traffic conditions, providing the data support for intelligent transportation systems, optimizing traffic signal control, improving road traffic efficiency, and alleviating traffic congestion. Monitoring environmental pollution sources helps to detect and address environmental pollution issues in a timely manner, protect the ecological environment, and improve environmental protection levels. It can realize intelligent perception of the home environment, provide the data support for smart home systems, and promote the development of the smart home industry. It can realize real-time monitoring of human physiological signals, provide the data support for the medical and health field, and promote the development of telemedicine, intelligent healthcare, and other fields.

In the field of industrial production, the new generation of multimodal stereo perception cameras can effectively improve production efficiency and quality. By monitoring the status of materials and equipment on the production line in real-time, the intelligent control and scheduling of the production process can be achieved, thereby reducing production costs and improving the production efficiency. At the same time, the camera can also perform precise 3D modeling and quality inspection on products, ensuring the quality and stability of the products.

In the field of autonomous driving, the project technology can provide vehicles with powerful environmental perception capabilities. By monitoring the surrounding environment in the real time, this camera can accurately identify and track information such as pedestrians, vehicles, and obstacles, providing decision-making basis for the intelligent driving system of vehicles. In addition, the camera can also achieve real-time monitoring of road conditions, providing more accurate map data and path planning for autonomous vehicles, improving the driving safety and comfort.

5. Contact Method:

Contact person: Zhang Guanyu

Tel: 17808077691