A Virtual Retinal Display For Augmenting Ambient Visual Environments

by Michael Tidwell

[Previous Chapter][Table of Contents][Next Chapter]


Chapter 7: System Design

7.1 System Design Overview

Chapter 7 describes functionally and graphically, the system design and layout developed for this thesis. An overall block diagram of the system is shown in Figure 7.1. The system is described in Chapter 7 from the light sources to the final viewing optics. Each major aspect of the electro-optic design is then discussed in a separate section. Those sections are:

Light Sources and Modulation (7.3)

Fiber Coupling (7.4)

Gaussian Beam Propagation (7.5)

Scanning (7.6)

Viewing Optics (7.7)

Appendix A supplements the material in this chapter. Appendix A contains photographs of the fiber coupling scheme, the Mechanical Resonant Scanner, and the see-through viewing optics (see Figures A1-A6).

Figure 7.1: System block diagram.

7.2 General Operation

Each video output channel (red, green, and blue) of the computer monitor is fed to the video electronics. The system electronics captures horizontal and vertical scan synchronization signals and video signal levels for all three colors. The analog video signal is converted to digital format and stored in temporary memory. The stored information is then read at the appropriate time, converted back to an analog signal, and used to modulate each light channel. The modulation scheme for the red source is direct current modulation of a laser diode.

The modulation scheme for the blue and green sources is acousto-optical (A-O) modulation. The video electronics amplitude modulates a 260 [MHz] carrier frequency generated by the A-O modulator sub-electronics (not shown in Fig 7.2.). The intensity modulated red, green, and blue light beams are then coupled into a single mode fiber of core diameter 3.1 [mm]. Fiber focusing optics focus the light exiting the fiber. The

tri-color beam enters the scanner assembly. The scanner assembly deviates the beam through a total angle of 25 [deg.] at a rate of 15.75 [kHz] in the horizontal direction and 18.75 [deg.] at a rate of 60 [Hz] in the vertical direction. The viewing optics collimate the tri-color beam, magnify the scan angle by a factor of 1.6, and present the video image to the eye.

7.3 Light Sources and Modulation

7.3.1 Light Sources Used

The red light source for this design was a Toshiba TOLD9421 diode laser with collimation optics. The source wavelength is 650 [nm] and the laser has an optical power output of 3.0 [mW] at full intensity.

The green light source was a Uniphase model 1676 green Helium-Neon (HeNe) laser of wavelength 543.5 [nm]. The maximum optical power of this device is 1.5 [mW].

Blue light is generated at 488 [nm] by an air cooled argon laser. The laser was purchased from MWK Industries and is believed to be an Omnichrome model 532 but the identity of the manufacturer was not guaranteed because the laser was purchased "used". The cavity of the laser contains a UV filter so as to protect the viewer from any unnecessary UV light entering the eye. The maximum power output of the argon laser is 14.5 [mW].

7.3.2.1 Intensity Modulation
Two schemes were applied to intensity modulate the laser light. The red laser diode is directly current modulated and the green and blue lasers are modulated by external acousto-optic intensity modulators.

7.3.2.2 Laser Diode Modulation for Red Channel
The small rise time of the solid state diode laser device allows high bandwidth (up to 100[MHz]) analog modulation. The video electronics regulate the voltage seen by the laser current driver. The laser current drive is a LiCONiX model LD200-22 and it controls the current passing through the laser which in turn controls the light output power from the laser. The laser diode is operated between amplitudes of 0.0 and 80.0[mA].

7.3.2.3 Acousto-Optical Modulation of Green and Blue Channels
Acousto-optic (A-O) modulators intensity modulate the green and blue laser beams. Acousto-optic modulators create a sound wave grating in a crystal through which a light beam passes. The sound wave creates alternate regions of compression and rarefaction inside the crystal. These alternating regions locally change the refractive index of the material. Areas of compression correspond to higher refractive indices and areas of rarefaction correspond to lower refractive indices. The alternating areas of refractive index act as a grating and diffract the light. As the sound wave traverses the light beam, the diffracted beam is intensity modulated according to the amplitude modulated envelope on the carrier signal. The acousto-optic modulators and accompanying RF drivers used for this project were from Neos Technologies, models N15260 and N21260 - 0.7AMSY respectively. Figure 7.2 depicts the physical situation in an A-O modulator:

Figure 7.2: Schematic of sinusoidal acoustic grating in an acousto-optical modulator.

The successive horizontal lines in Figure 7.2 represent the modulated acoustic wave and the corresponding regions of refractive index variation [4]. The rise and fall time of the modulation in an A-O modulator is roughly [48]:

t = [(D/(1.5 Va))2 + (te)2]1/2.

where D = optical beam diameter in the acousto-optic crystal, Va = the acoustic velocity in the medium, and te = the rise time of the RF drive electronics for the A-O modulators.

The beam diameter D in the A-O modulator is taken here to be the diffraction limited spot formed by the focusing lens,

D = 1.22 (534.5 10-9) (0.04) / (0.0004)

= 65.2 [mm]

where the wavelength is 534.5 [nm] for the green HeNe laser, the focal length of the focusing lens is 40 [mm], and radius of the limiting aperture is 0.4 [mm] and corresponds to the radius of the initial laser beam. The A-O modulator material is "fast" crystalline TeO2 (tellurium dioxide). The velocity of sound in "fast" TeO2 is

4.2 [km/sec] at 260 [MHz] [48]. The A-O modulators used for this project have:

t = [(65.2 10-6 / 6.3 103)2 + (3 10-9)2]1/2

= 10.8 [ns].

where te = 3 [ns] for the A-O modulators in this project. A rise time of 10.8 [ns] is a best case scenario. In all likelihood aberrations in the focusing lens and misalignment will cause the beam diameter in the acousto-optic material to be larger and consequently to lengthen the rise time.

For the A-O device to be of any use the diffracted orders must be separable. Otherwise, the modulated and unmodulated orders mix. Gaussian beam theory states the smaller a Gaussian beam is focused, the greater the beam divergence (after the focused spot). If the optical beam is focused to a very small spot (to decrease the rise time of the modulator), the beam divergence is likely to cause overlap of the diffracted orders in space.

To correct this overlap, a higher carrier frequency is required. The higher carrier frequency, or frequency of the sound, creates a closer spacing in the diffraction grating generated by the sound column. The closer spacing in the diffraction grating causes greater separation of the diffracted orders. For this design an A-O modulator with a carrier frequency of 260 [MHz] was selected. The angular separation of the undiffracted and first diffracted order, 2qB, where qB is the Bragg angle is [4]:

2qB = 2 sin-1[l/2L]

where L = wavelength of sound in the material, and l = wavelength of light in the material. For the A-O modulator in this project,

L = 16.15 [mm]

lg = 1170.4 [nm] (green channel)

lb = 1073.6 [nm] (blue channel).

Correspondingly, the angular separations of the orders for the green and blue channels are:

2qBg = 2 sin-1[1.1704 x 10-6 / ( (2)(16.15 x 10-6) )] = 72.45 [mrad]

2qBb = 2 sin-1[1.0736 x 10-6 / ( (2)(16.15 x 10-6) )] = 66.45 [mrad].

7.4 Fiber Coupling

7.4.1 Fiber Coupling Approach

The fiber coupling scheme for this design combines light from the three separate laser sources into a step index single mode optical fiber of core diameter 3.1[mm]. Dichroic 45 [deg.] reflectors combine the beams while lenses focus the beams to a spot for coupling into the fiber. Figure 7.3 diagrams the fiber coupling scheme.

Figure 7.3: Schematic diagram of the laser to fiber coupling.

Lenses lg1, lg2, lb1, and lb2 are focusing and collimation lenses for the A-O modulators on the green and blue channels respectively. Lens lr1 is the corrective optic (for collimation) mounted on the laser diode and lens lw1 is the focusing optic for coupling the combined red, green, and blue channels into the optical fiber.

7.4.2 Cutoff and Normalized Frequency in a Step Index Single Mode Fiber

A parameter called the normalized frequency, V, determines the cutoff condition for single mode operation in single mode fibers [4]. For a step index fiber,

V = 2pa(n12 - n22)1/2/l

where a = core radius, n1 = core refractive index, n2 = cladding refractive index,

and l = freespace wavelength of the light. The cutoff condition in a step index fiber for single mode operation requires,

V 2.405.

The wavelength corresponding to cutoff, lC , can be found by setting V = 2.405 and solving for l:

lC = 2.61a(N.A.)

where,

N.A. = (n12 - n22)1/2

and is the numerical aperture of the fiber. For the fiber used in this project,

a = 3.1[mm]

N.A. = 0.11

and

lC = 445 [nm].

lC is the shortest wavelength which the fiber can carry and remain single moded. The wavelengths in this project are all longer than the cutoff wavelength and the fiber can be assumed to be single moded for all colors in the display.

7.4.3 Gaussian Approximation of Fiber Mode

The mode field solution in the cylindrical step index waveguide problem is, in general, not Gaussian in profile or propagation. The mode diameter, however, can be approximated to within 1% with a Gaussian approximation [42]. The general approach to the approximation is to model the mode with the Gaussian profile which produces the highest launching efficiency into the LP01 mode.

The mode spot radius, wo, can be calculated as the Gaussian equivalent beam radius that best approximates the LP01 mode profile [43]:

wo = a(0.65 + 1.619V -1.5 + 2.879V -6)

Table VII.1 shows the values of V and wo for the wavelengths and fiber used in this display.

Table VII.1. Values for normalized frequency V and mode spot size wo.

Channel
Wavelength [nm]
Normalized Frequency, V
Mode Spot Radius, wo [mm]
Red
650
1.65
2.41
Green
543.5
1.97
1.99
Blue
488
2.19
1.82

For the values in Table VII.1, more than 97% of the power from coupling on the green and blue channels will be launched into the LP01 mode [42]. The mode launching distribution from the red diode laser is more complicated and not discussed here.

7.5 Gaussian Beam Propagation

7.5.1 Propagation of Guassian Beams

The propagation characteristics of an unguided Gaussian beam are presented here because Guassian beams do not follow geometrical optical rules and any analysis of Guassian beams should include diffraction considerations from the outset [2].

A Gaussian beam behaves, qualitatively, as shown in Figure 7.4.

Figure 7.4: Illustration of Gaussian beam behavior near beam waist.

Figure 7.4 shows the beam waist diameter d0, the angular divergence q, and the beam diameter as a function of the distance z away from the beam waist. Under geometrical rules, a beam converging at an angle q should eventually converge to a point [2]. Diffraction, however, does not allow this to happen. The beam waist diameter is a function of the divergence q and the wavelength l of the light:

d0 = 4l/pq.

Near the beam waist, the beam profile has a parabolic form such that

d = d02 + q2z2.

Rewriting gives

d = d0(1 + (qz/d0)2)1/2.

A distance called the Rayleigh range determines the extent over which one should take into account diffraction considerations for a Gaussian beam. Outside the Rayleigh range, wavefronts of the beam approach geometrical limits. The Rayleigh range is defined as the value of z where d = (2)1/2d0. This value of z is

z = zR d0/q.

The thin lens equation for Gaussian beams leads to predictions of beam waist size and location for paraxial lenses. If necessary, more detailed analysis can be done with ray trace software on a computer if coupling efficiency is insufficient. The Newtonian form thin lens equation for Guassian beams is

(z - f)(z - f) = f2 - f 02

where z = the distance from the front focal point of the lens to the initial beam waist diameter do , z = the distance from the back focal point of the lens to the new beam waist diameter d0, and

f 0 = (zRzR)1/2

or alternatively

f 0 = d0/q = d0/q.

and is added for diffraction effects [2]. The distance z is positive if the initial beam waist is outside (to the left of) the front focal point of the lens and negative if the reverse is true. The distance z is positive if the new beam waist is outside (to the right of) the back focal point of the lens and negative if the reverse is true.

It can be shown [2] that the new beam waist diameter is written in terms of the initial beam waist as:

d02 = f2d02/[(z - f)2 + zR2] = a2d02

where

a = f / [(z - f)2 + zR2]1/2.

Once a is calculated from known quantities, the new beam waist diameter, new divergence, and new Rayleigh range can easily be evaluated:

d0= ad0

q = q /a

zR = a2zR.

Clearly a shorter focal length focusing optic will produce smaller new beam waist diameter. A shorter focal length optic will also, however, be less forgiving in terms of angular misalignment as any angular difference in the incoming beams will be angularly magnified.

7.5.2 An Optical Fiber as a Tri-color Resolution Element

The light emanating from the core of the single mode fiber is the resolution element for this VRD. The radiation consists of red, green, and blue light at intensity levels corresponding to the video signal and controlled by the video electronics. The image of the fiber core light on the retina is the spot size of this display.

7.6 Scanning

The scanning device in this system consists of a mechanical resonant scanner and galvanometer mirror configuration. The horizontal scanner is the mechanical resonant scanner (MRS) shown in Figure 7.5 developed by David Melville at the H.I.T. Lab [45]. The MRS has a flux circuit induced by coils which are beneath a spring plate. The flux circuit runs through the coils and the spring plate and alternately attracts opposite sides of the spring plate and thereby moves the scanner mirror through an angle over time.

The version of the MRS used for this project is tuned to 15.75[kHz] with a mechanical deflection of 3.125 [deg.]. The vertical scanner is a Cambridge Technologies model 6800 galvanometer mirror operated at a mechanical deflection of 4.7 [deg.]. The galvanometer deflection can be selected according to the aspect ratio of the display and a ratio of 4:3 was chosen for this design. The galvanometer frequency is controlled by the video electronics to match the 60 [Hz] video frame rate.

Figure 7.5: Mechanical Resonant Scanner device.

The galvanometer and horizontal scanner are arranged in what is believed to be a novel configuration such that the horizontal scan is multiplied [45]. The scanners are arranged, as shown in Figures 7.6 and 7.7., such that the beam entering the scanner assembly first strikes the horizontal scanner then strikes the vertical scanner. The beam is reflected by the vertical scanner back to the horizontal scanner before exiting the scanner assembly. The beam therefore strikes the horizontal scanner twice before exiting the scanner configuration. In such an arrangement, the first scan (corresponding to the first bounce or reflection) is doubled by the second scan (corresponding to the second bounce or reflection). The case shown is for q = 45 [deg.] wherein the exit beam returns parallel to the horizontal incident beam. In Figure 7.6 the MRS is undeflected and in Figure 7.7 the MRS is deflected by d [deg.].

Figure 7.6: MRS/Galvanometer scanner assembly showing incident and exit beam paths for the MRS in an undeflected position.

Figure 7.7: MRS/Galvanometer scanner assembly showing incident and exit beam paths for the MRS in a deflected position.

The result of arranging the scanners as in Figures 7.6 and 7.7 is a doubling of the horizontal optical scan angle. Other configurations have been applied to this approach to achieve a tripling in the horizontal direction and simultaneously a doubling in the vertical direction [45].

7.7 Viewing Optics

The viewing optics, or the optics through which the user sees the intended image, are diagrammed in Figure 7.8. The convergent tri-color beams emanating from the scanner pass (partially) through a beamsplitter. The beamsplitter (or beamsplitter/combiner) is coated such that 40% of any light striking it is reflected and 60% is transmitted. The transmittance/reflectance is somewhat angle dependent but this dependence is not severe. On first pass, 60% of the energy in the scan is transmitted through the splitter/combiner to a concave spherical mirror.

Figure 7.8: Schematic of viewing optics section of the display.

The mirror is actually a rectangular section of a spherical mirror with radius of curvature -100 [mm]. The negative sign denotes concavity. Dimensions of the mirror are given in Table VII.1.

Table VII.1. Dimensions of rectangular section of spherical mirror.

Dimension
Value[mm]
width
47.0
length
62.0
depth
12.0
radius of curvature
-100.0

The mirror collimates the individual ray bundles which are focused at the focal point of the mirror. The mirror also angularly magnifies the scan by a factor of 1.6. The ray bundles now reflect off the mirror onto the beamsplitter/combiner. The beam splitter is a 2 [mm] thick parallel plate beamsplitter which is anti-reflection coated on one side to reduce double reflections. 40% of the remaining light, or 24% of the energy present in the original scan, is then reflected into the eye. As the beamsplitter is 60% transmissive, the natural surroundings are also seen by the viewer. The combination of the scanner and the viewing optics generate a scanned raster on the retina which is perceived as a

40 [deg.] horizontal by 30 [deg.] vertical virtual image. It is the aspect of seeing the outside environment and the virtual environment simultaneously which creates an environment of augmented vision.


Human Interface Technology Laboratory