Reply to Comment by Dr. Steven L Smith: Why Troyer Patents Strong; Discuss “Hologram”

Filed under: #5DReality, #IFITIS5D, #MetatronZ, #HIVE5D,  Laser Video Projector,—

Note: The original answer to Dr. Smith has been upgraded (dates), etc.

This message was sent to my HIVE ZELF Holographic Immersive slide share document. It is from Dr. Steven L Smith; Optical Engineer and 3D Imaging Specialist and a Senior Research Fellow of Modern Holography at De Montfort University (Boston). Smith has been a purist about using the word “hologram”.

Diane, I reposted here so that you know who posted this comment, I cannot comment) on your patent issues that seem to be many from this presentation. Importantly though I want to caution you on using the work ’holographic’. This term is not a catch all phrase for any ’potentially 3D’ media, but specifically designates a type of 3D image that is Phasebased in the reconstruction of spatial information through the generation or playback of fringe gratings that reconstruct an objects wavefront, a subset if you will of the wider 3D imaging process. your process is not a phase based 3D imaging process. In fact that very point that you make that your image is in focus everywhere goes to prove that it is not a 3D wavefront that has been created but a 2D image projection. 3D wave fronts focus at the point of an objects location and diverge again from that point. All other issues that you are making in this presentation related to your prior art probably will inevitably have to be sorted out in a court just due to the very long history of laser scanning and projection. best of luck

This is the Troyer reply (updated).

Hi Steven, Thanks for the comments and wishing me luck. May I respond?  The first section is about the patents. The second is about the MetatronZ patented process and the label holographic.

Troyer laser projector patents.  You probably have not had a chance to read my patents or claims. Or to compare my patents to the Kodak laser projector patents or others.  Having the Canadian patent granted in 2013 establishes a great strength to my Troyer Patent Portfolio. The Canadian patent is based on my 2001 US and combined patent claims of 2001, 2005 and 2006.

The Canadian patent office is very good with their research. Also the data bases are much more up to date in 2012 than they were in 2001 when my USA patent was issued. The Canadian patent office did a global search for any prior art, including all previous work including papers, speeches as well as patents. They found no prior art for my claims: full spectrum color over 635 nm red and lasers addressed to a reflective light valve (scanning as one of the approaches). The claims broaden to all RLV including DLP, LCoS, MEMS, LED or any to be invented. It is recommended for best images that have dimensional depth that the spatially modulated laser keeps the attributes of the laser to the screen (polarization, coherence and collimation).

The Troyer patent portfolio and claims are explained at this site http://www.slideshare.net/fullscreen/metatroy/troyer-patent-portfolio-2012/2

Also this explains the Claim Chart and infringements

Troyer patent charts 101413 from Diane Troyer

IF IT IS — Innate Focus; Instant Transfer; Infinite Sharpness  #IFITIS5D

The image information is transformed with light-field depth (Z factor) when spatially modulated into the collimated laser beam. The Z factor is inherent in the image to the screen, the screen being any form or volume (could be fog, plasma, Cinerama, dome, etc.).

Brightness: We find that expanded laser beams that are scanned down the reflective light valve (RLV) provide the best approach for brightness, heat mitigation, and contrast. Fast scanning expanded laser beams do not cause heat. Also it is the most efficient use of the laser light. Unlike with other methods, almost all the laser power is used on the screen. The entire laser light is in the expanded laser beam ribbon. The laser brightness is evenly distributed on the screen. All the laser brightness is in the ribbon that scans in bands at 60 cycles per second or faster.  More than one scanning laser beam can be used. Full flood of combined expanded laser beams does not work as well because it is difficult to control the artifacts and the even distribution of brightness. Also static laser flood causes great heat that has to be mitigated. This would limit using LCoS that does not tolerate direct heat. The most efficient approach is to have scanning (moving) expanded laser reading beams that modulate the writing image.

Laser Scanning: The Canadian patent office has sorted out the “long history of laser scanning” projection and has granted Troyer patent claims as original art, thus confirming the US patents as “strong”.  Doubt is caused because IMAX is claiming they have the laser projector patents from Kodak for digital cinema.

http://video.foxbusiness.com/v/1222364361001/imax-ceo-on-laser-projection-patents-deal-with-kodak/

It will not take a court battle to figure out that Kodak patents do not cover my patented process which is the simplest way to create the best laser images.  Even though probably members of the LIPA Laser Projection consortium are hoping their representations are not questioned.  LIPA companies state they have invented laser imaging and present digital laser projectors for the first time. IMAX, Kodak, Disney, Sony, BARCO, Dolby, JVC, etc. experts have all attended MetatronZ demonstrations at the Troyer lab and received paper work– white papers long before the LIPA consortium was formed. The California Company, Metatron Inc. was started in 1992 to develop and commercialize laser projection. The first patent was granted in 1994 for solid state laser projection. Troyer (me) and my team have been working on this invention for a long time. The Griffin Group backed the building of the prototype. Metatron Inc. was OEM to JVC using the Hughes/ JVC ILA digital projector as our base.

Kodak Patent: Soon after the Kodak representative saw the MetatronZ Laser demonstration at Lexel Laser in Fremont, California (Silicon Valley), they published a patent in Europe. This is the Kodak patent closest to Troyer’s approach with expanded laser beam addressed to a spatial light valve. The Kodak claims cover an added optic to get rid of speckle.  Troyer’s patent also covers the elimination of speckle in great detail. The Kodak patent that adds an optic to the Troyer process does not provide IMAX and the other companies the right to infringe on the Troyer patents.

Another Kodak patent written after the Troyer 2001 patent states that additional colors can be added with RGB, but no specific wave lengths are mentioned in the claims.  Troyer claims cover fuller spectrum red and also using near 488 nm. for added cyan (blue – green). The Troyer claims also allow more colors to be added (assuming other nanometers of red and blue and green and/or magenta and yellow). The Kodak patent also states that “blue-green” is the best color to add and that it provides more brightness. The Kodak claims, however, suggest a different way to modulate the four or more colors, since full spectrum RGB, plus added colors has already been claimed in the Troyer patents. Canada would not have granted Troyer the claims if they had found that Kodak had prior art.

Claims: Looking at claims and patents is a job in itself, but you might enjoy reading Troyer’s 2001 patent on lasers addressed to a reflective light valve.  Also with a quick look at the Kodak patents, you will realize that many are based on a grating light valve approach which reduces the brightness and breaks the coherence, collimation and polarization in the laser beam.

Thus Kodak used the Troyer patented KISS (keep it simple streamline) approach to design their laser projector demonstration model. If Kodak had used their grated light valve approach, they would not have been able to present 3D unless they used many extra optics to re-polarize the laser beam. It is a necessity to keep the polarization and coherence to produce decent 3D. In writing my Troyer patent, I was very aware of the importance of retaining the laser beam’s coherent and polarization for the automatic adjustment to any irregular screen (Domes, Cinerama, simulation, water screen, etc.) and for dimensional imaging (3D) without glasses.

The Troyer patent teaches best method for keeping the natural polarization of the laser beam throughout the optic train to the lens and out to the screen. The patent claims do not limit how many laser beams can be used on the light valve. The Troyer published white papers discussed the two channels with different polarizations in 2001 and 2003. The white papers were provided to those attending the demonstrations.  I realize, however, the best use of the patented process is with the one channel dimensional approach that can be discussed later.

Previous Art: As stated, the Troyer patent claims stress directing a laser to a reflective light valve. Troyer stressed keeping the laser attributes in the modulated laser beam image.  Before the art was to use an AOM, which also kept the laser attributes. This was not eye safe in the fact that the laser beam was scanned directly out of the lens. Laser beams are dangerous to the eyes. The Troyer patent expands the laser beam into a ribbon that is directed to the full width of the light valve and then reflected off the light valve and out of the lens, which makes a more eye safe method for FDA approval. The claims cover using full colored images (red 635 nm or over). The former art was to use an orange red at that time (610 nm.) for more brightness and to match the NTSC color images. No one made these claims before for the most streamlined and eye safe method.

HOLOGAPHIC

Now to Holographic: Your point is well taken. I was calling the process “auto dimensional”. But now I feel by definition we are doing a new form of “holography”—or at least it will be considered so as the art evolves.  By taking the infinite focus (IF IT IS) attribute into consideration, we can create the simile of holographic colored images in real time.

Please see my Z factor power point to understand the depth factor with the spatially modulated laser beam. MetaZtron holographic Z depth factor.pdf

One Aspect Covered by Troyer Patent Claims:   Laser Diode Approach: Small near infra-red modulated diodes, 3 phase image scan (X Y and Z) captured by camera sensor.  This can be one module, several or many. Different slices of the image can be merged. More than one reflective light valve (RLV) can be used to capture the laser diode 3D images. The near infrared sensor captures the 3D images in real time (this is considered the writing phase of the RLV). Bright colored expanded laser beam light is applied to the reflective light valve (reading stage of the RLV) and the captured 3D image is spatially modulated into the expanded laser ribbons. This creates full colored dimensional imaging. Many XYZ images or for that matter different splices can be captured and combined. The images can also be optically combined after the light valve reading beam captures the Z depth images.  We know through tests that the spatially modulated images then become holographic. The screen can be plasma or another volume screen.  Also with the Z factor the images hoover on a curved simulation, Cinerama screen or a dome or irregular screen. Specialty designed chips increase the effect. Several Metatron projectors can be used for different image sides in 360 degree surround space.

Use Infrastructure and COTS: The industry needs a process now that uses the infrastructure that exists.  Today the military, medical, industry need high resolution 4K images for simulation, immersive training, security devices, etc.  For this purpose, we use COTS—and the infrastructure that is in place. A 4K LCoS or other HD device (DLP) can be directly addressed. Variations:  Use a 4K LCoS that has been provided depth images that have been real time translated into more depth. Light Blue Optics described a “holographic” program that is a great description of the Troyer patented process.   http://www.youtube.com/watch?v=7JnWKPqR6uM

Big Dome Screens: Using the LCoS, DLP, OLED or other high resolution device to write the image (sensor captured). The reflective light valve larger surface provides more space for the wattage power of the addressed high colored laser power.

Applications: Software — chip (algorithm) can be designed with IF IT IS attributes taking into consideration the spatially modulated Z depth images. The #IFITIS5D attributes streamline the classic 2D to 3D chips. Also software can be designed for real time merging of 3D two channel images into one channel that has infinite sharpness and depth of focus. This is not as effective as capturing in one channel that has light field in focus depth. The images adjust to the volume or curved screen. The imager is chosen (LCoS, DLP, OLED, or any to be invented). The imager can be near infrared and share the gray scales or can be captured with real colors. The reading sensor is designed to capture with depth the near infra-red or color images.

Slice Views: The LCoS or OLED or other best imager displays the different views. There is ongoing research to get “holographic like” best image.  The spatial image views with Z depth can be projected with the MetatronZ from different angles. Great auto dimensional images are formed that can be seen from any angle, including the rear when creating the 360 degree surround images. Three MetatronZ projectors can display curved surround images.  This might seem complicated, but is really simple with #MetatronZ ability to project in curved space. Lasers do not decay or fade in color and brightness. Laser produce straight edges that are easy to merge.

CAVE/ HIVE: Iowa State University used 24 Sony 4K LCoS arc lamp Sony projectors for their stereo immersive 10 ft. by 10 ft. by 10 ft. flat walled CAVE (merging colors and brightness and edges difficult with arc lamps). The CAVE has been researched and assembled in many global Universities, science centers and labs. At least with the MetatronZ (HIVE) dimensional images can be created (without glasses). Curved walls can replace flat walls. Double projectors do not have to be used for stereo.  The HIVE can be much larger than the CAVE and provide realistic vivid dimensional images, without glasses. The HIVE is less costly. Fewer bright MetatronZ 4K projectors are needed. #HIVE5D

Holodeck Playpen: Smaller MetatronZ projectors can be set up in surround position to create a more holodeck process for immersive training. We call the HIVE (Holographic immersive virtual environment) a Holodeck Playpen. #HIVE5D

Cameras with in focus Phase Foreground/Background: Maybe with IF IT IS attributes as part of the formula, the camera sensors can be modified to capture always in focus one channel images to go beyond the two channel process?  #IFITIS5D. Several groups are working on such sensors.

Great Application Potential Stimulates Crowd Sourcing: The MetatronZ Invention is the linchpin for many apps created for the MetatronZ HIVE platform (#HIVE5D). This most streamlined approach is a good base platform that can evolve.   At least now curved space instead of flat walls can be used for real time auto dimensional imaging. The images have a large field of view, always in focus wherever the person stands. The proscenium approach is used, meaning there is a frame of the view. The audience does not view the back of the image. Live theater such as Opera has almost always had this approach (proscenium is looking through an open door). Troyer calls this the MetaShell platform. The dimensional images are designed for the participant or audience viewing from the front or sides or above. This is a great first step and can be done with the infrastructure that exists now.

Real Time: This description is of a patented platform base for real time colored holographic type images.  Maybe this is not the classic hologram as we know it, but still takes into account the basic holographic principles. It is suggested since the IMAX domes are built and available and closing because of no film content being provided, that the MetatronZ process of delivering any streaming video be used, the feed instantly transformed (IT) to auto dimensional images that automatically adjust to the curved screen. Then all else can follow.

Camera and Projector: Troyer received a new patent on Valentine Day. Feb. 14, 2012. Thus a laser apparatus with a projector and camera that produces full spectrum color and high contrast dimensional imaging. The camera capture in real time is transformed into vivid film like spatial images.  Multiple images can be captured with sensors (writing).Then transformed in real time to full color high contrast (real blacks) dimensional images.  If the sensor has built in space allocation to capture multiple images and has sliced capture of all sides then another aspect can be explored. The camera sensors have evolved according to the Moore’s law.

Images are modulated into spatially modulated Z depth expanded laser beams. The MetatronZ acts as an amplifier that enlarges the images retaining the inherent resolution. The process automatically replicates, enhances, and amplifies any feed. The amplified image does not have artifacts. It does not have huge pixel squares in the image. This is not the classic film two laser split wave front hologram, but a different process. So maybe a new word instead of Holographic should be coined for what we do?  Have any suggestions?

You state: “This term is not a catch all phrase for any ’potentially 3D’ media, but specifically designates a type of 3D image that is Phase based in the reconstruction of spatial information through the generation or playback of fringe gratings that reconstruct an objects wavefront, a subset if you will of the wider 3D imaging process. your process is not a phase based 3D imaging process. 

Why the MetatronZ Process Could Be “Holographic”?

Are you stating that our images are not phase based? Are you stating that our images are not reconstructed?  Yes, this approach removes the “film” process and replaces that process with real time sensor captured spatial images.  A sensor camera captures the image and it is transformed to a phase based reconstructed images in real time.

The MetatronZ process is phase based and is a real time reconstruction with spatially modulated information. No we do not use the splitting into two lasers, one as a scanner of the object and one for creating and image of the object.

MetatronZ works with #IFITIS5D, which is keeping the collimation, polarization, and coherence in each pixel (the inherent laser attributes).  This is hard to comprehend for someone who has not worked with laser modulated images.

Hologram Definition:  A three-dimensional image formed by the interference of light beams from a laser or other coherent light source.

As far as the word “Holographic” it is used here: http://www.musion.co.uk/

This is the Peppers Ghost technology which is definitely a bastardization of the hologram.

 “An industry dedicated to financing inventors and monetizing their creations could transform the world.”

 

 

Also this explains the Claim Chart and infringements

Troyer patent charts 101413 from Diane Troyer

IF IT IS — Innate Focus; Instant Transfer; Infinite Sharpness.