1 of 30

MAGIS 100

04/08/2021

Murtaza, Maxime

Lightfield imaging

2 of 30

Stanford Prototype

Window 5.6cm from chamber center

13.7 cm diameter window aperture

Just short of 10mm width

2

3 of 30

Number of Views & Light Collection

3

55 mm F1.6 Thin Lens

Minimum distance between virtual objects 1.5 mm

Minimum angular separation of Fobj cone on unit sphere

In Air Setup

(Assuming all the views have roughly the same object side F number)

Stanford Setup

(max number of views derived using in air assumptions)

m=.1504, FF (36x24) mm

3.76 um pixels

Object side F12.2 images

86o coverage

O(763/820) views

63.6% light captured of 2pi

Mirror radii [.14, .34] cm

PoF : 42.07 cm, Obj: 34.98 cm

47.5o coverage

O(266/820) views

22.2% light captured of 2pi

Mirror radii [.29, .36] cm

PoF : 42.07 cm, Obj: 27.75 cm

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

Object side F16.3 images

86o coverage

O(1349/1450) views

63.7% light captured of 2pi

Mirror radii [.08, .20] cm

PoF : 55.95 cm, Obj: 50.49 cm

40o coverage

O(339/1450) views

15.9% light captured of 2pi

Mirror radii [.20, .24] cm

PoF : 55.95 cm, Obj: 42.59 cm

4 of 30

Number of Views & Light Collection

4

55 mm F1.7 Thin Lens

Minimum distance between virtual objects 1.5 mm

Minimum angular separation of Fobj cone on unit sphere

In Air Setup

(Assuming all the views have roughly the same object side F number)

Stanford Setup

(max number of views derived using in air assumptions)

m=.1504, FF (36x24) mm

3.76 um pixels

Object side F13.0 images

86o coverage

O(860/925) views

63.5% light captured of 2pi

Mirror radii [.14, .32] cm

PoF : 42.07 cm, Obj: 34.98 cm

47.5o coverage

O(300/925) views

22.2% light captured of 2pi

Mirror radii [.28, .34] cm

PoF : 42.07 cm, Obj: 27.75 cm

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

Object side F17.3 images

86o coverage

O(1526/1640) views

63.7% light captured of 2pi

Mirror radii [.08, .19] cm

PoF : 55.95 cm, Obj: 50.49 cm

40o coverage

O(384/1640) views

16.0% light captured of 2pi

Mirror radii [.19, .23] cm

PoF : 55.95 cm, Obj: 42.59 cm

5 of 30

Number of Views & Light Collection

5

55 mm F1.8 Thin Lens

Minimum distance between virtual objects 1.5 mm

Minimum angular separation of Fobj cone on unit sphere

In Air Setup

(Assuming all the views have roughly the same object side F number)

Stanford Setup

(max number of views derived using in air assumptions)

m=.1504, FF (36x24) mm

3.76 um pixels

Object side F13.7 images

86o coverage

O(967/1040) views

63.7% light captured of 2pi

Mirror radii [.13, .30] cm

PoF : 42.07 cm, Obj: 34.98 cm

47.5o coverage

O(337/1040) views

22.2% light captured of 2pi

Mirror radii [.26, .32] cm

PoF : 42.07 cm, Obj: 27.75 cm

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

Object side F18.3 images

86o coverage

O(1712/1840) views

63.7% light captured of 2pi

Mirror radii [.07, .18] cm

PoF : 55.95 cm, Obj: 50.49 cm

40o coverage

O(430/1840) views

16.0% light captured of 2pi

Mirror radii [.18, .22] cm

PoF : 55.95 cm, Obj: 42.59 cm

6 of 30

Number of Views & Light Collection

6

55 mm F2.0 Thin Lens

Minimum distance between virtual objects 1.5 mm

Minimum angular separation of Fobj cone on unit sphere

In Air Setup

(Assuming all the views have roughly the same object side F number)

Stanford Setup

(max number of views derived using in air assumptions)

m=.1504, FF (36x24) mm

3.76 um pixels

Object side F15.3 images

86o coverage

O(1191/1280) views

63.6% light captured of 2pi

Mirror radii [.12, .27] cm

PoF : 42.07 cm, Obj: 34.98 cm

47.5o coverage

O(415/1280) views

22.2% light captured of 2pi

Mirror radii [.23, .29] cm

PoF : 42.07 cm, Obj: 27.75 cm

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

Object side F20.3 images

86o coverage [ 1.42 mm dist. ]

O(2112/2270) views

63.7% light captured of 2pi

Mirror radii [.07, .16] cm

PoF : 55.95 cm, Obj: 50.49 cm

40o coverage

O(531/2270) views

16.0% light captured of 2pi

Mirror radii [.16, .19] cm

PoF : 55.95 cm, Obj: 42.59 cm

7 of 30

Simulation results - Stanford Setup

7

55 mm Thin Lens

300um features

F1.6

F1.7

F1.8

m=.1504, FF (36x24) mm

3.76 um pixels

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

  • Simulations include quantum & readout noise at sensor.

8 of 30

Simulation results - Stanford Setup

8

55 mm Thin Lens

200um features

F1.6

F1.7

F1.8

m=.1504, FF (36x24) mm

3.76 um pixels

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

  • Simulations include quantum & readout noise at sensor.

9 of 30

Simulation results - Stanford Setup

9

55 mm Thin Lens

200um features

F1.6

F2.128

m=.1504, FF (36x24) mm

3.76 um pixels

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

  • Simulations include quantum & readout noise at sensor.

Both now ~ F16.3 object side

10 of 30

Simulation results - In Air Setup

10

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

F1.6; 100um features

m=.1504, FF (36x24) mm

3.76 um pixels

F1.6; 100um features

[38% more light in max]

60 x 60 pixels

60 x 60 pixels

11 of 30

Simulation results - Conclusion

  • Smaller sensor is better adapted for the Stanford setup.
    • Smaller light cone leads to less blurring
    • 200um features seem reasonable for a proof of concept.
  • Larger sensor gives us more angular coverage
    • Can mitigate blurring by stopping lens down
  • Results in air are pretty much identical (modulo light collected)
    • May require quantitative assessment?
      • Blur & 3d reconstruction.
  • Do we want to add Lens model to this?

11

12 of 30

12

13 of 30

Number of Views & Light Collection

13

F1.6 Thin Lens

Minimum distance between virtual objects 1.5 mm

Minimum angular separation of Fobj cone on unit sphere

In Air Setup

(Assuming all the views have roughly the same object side F number)

Stanford Setup

(max number of views derived using in air assumptions)

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

Object side F16.3 images

85mm Lens

86o coverage

O(1349/1450) views

63.6% light captured of 2pi

Mirror radii [.09, .22] cm

PoF : 86.48 cm, Obj: 80.81 cm

40o coverage

O(339/1450) views

15.9% light captured of 2pi

Mirror radii [.22, .26] cm

PoF : 86.48 cm, Obj: 72.42 cm

m=.109, 1.1” (12.3x12.3) mm

2.74 um pixels

Object side F16.3 images

100mm Lens

86o coverage

O(1349/1450) views

63.6% light captured of 2pi

Mirror radii [.09, .22] cm

PoF : 101.74 cm, Obj: 96.02 cm

40o coverage

O(339/1450) views

15.9% light captured of 2pi

Mirror radii [.22, .26] cm

PoF : 101.7 cm, Obj: 87.48 cm

14 of 30

Stanford Prototype

Assuming window 5.6 cm from cloud either side

Window aperture diameter is 13.7 cm, radius 6.9 cm

We should be able to capture views within +/- 51o

55 mm lens could be too tight,

Zeiss makes 85 mm (m=.129) & 100 mm (m=.116) lenses

https://www.zeiss.com/consumer-products/us/photography/videography/otus-lenses.html

14

15 of 30

Stanford Prototype - Camera 1 FF Sensor

  • Keep m = .1504 since these are 3.76 um pixels
  • We ask for densest mirror packing, and want to know number of views with mirrors past x = 5.6 cm
  • Most extreme view that’s accommodated is +/- 48o

15

16 of 30

Stanford Prototype - Camera 4 - Global Shutters!

Based on the Sony IMX530/540/541 [4/3 or 1.1” sensors]

GigE/USB3.0 variants. 2.74 um pixels, m=.109, can use all 3 lenses, O(250) views

Angular acceptance = +/- 40o

All seem to quote “Temporal Dark Noise” ~ 2-3 e, some in addition say ~2e/s ?

QE is lower at ~ 70%

Don’t look cooled, but I might be wrong. USB3.0/GigE interface should allow for triggering, global shutters are a good bonus here.

Look like they’re all in the $1.9k to $3k range

16

17 of 30

Do we want to develop this?

https://www.sony.net/SonyInfo/News/Press/202103/21-021E/

  • 3.45 um pixels, 13,400 x 9,528
  • Diagonal 56.73 mm (3.6-type)
  • Main functions -

Global shutter,

trigger synchronization, ROI,

gradation compression,

multi-exposure, short exposure,

pixel binning readout

  • Chris: It uses the Sony SLVS-ED interface. Xilinx offers IP for this https://www.xilinx.com/products/intellectual-property/1-yx5i51.html
  • Ryan Herbst will get back to us about how much effort it will take to read the sensor

17

18 of 30

A little bit of 1D fourier space maths...

What does our density function look like?

18

In Fourier space this is a convolution of the FTs from N and sin2

19 of 30

A little bit of 1D fourier space maths...

19

Real

Imaginary

setting b=0

In Fourier space this is a convolution of the FTs from N and sin2

20 of 30

Density used

20

21 of 30

3D fourier picture of our cloud

21

Real

Imaginary

Absolute

22 of 30

How to best represent clouds?

22

Colors - Interpolation

Glyphs - Points

23 of 30

How to best represent gradients?

23

24 of 30

A little bit of 1D fourier space maths...

Ray tracing approach lets us estimate the density of the atom cloud directly

→ Estimate the density as a Gaussian mixture

24

25 of 30

A little bit of 1D fourier space maths...

→ Can we estimate the FT of the density as a Gaussian mixture?

We’ll need to take the complex part into account somehow...(Add mixing angle parameters?)

25

Here x is the fourier space variable

Inverse FT to recover the density of the cloud

26 of 30

Lens Numbers

  • 55mm F1.4 Zeiss Otus BB sent by Zeiss
  • OTFs evaluated by Engineer-Michael
  • Consider now +- 6mm on the image sensor
  • MTF cyc/mm corresponds to one full period of the sine wave modulation
    • Worst case MTF with 100um wavelength sine waves ~ 30%
    • Worst case MTF with 200um wavelength sine waves ~ 75%
  • With 200um cycles, overall contrast ratio ~ 67%

→ brightest pixel = 5 x dimmest pixel value

  • With 100um cycles, overall contrast ratio ~ 20%

→ brightest pixel = 1.5 x dimmest pixel value

26

27 of 30

Approximate Light Collection Numbers

106 atoms & 108 𝛾/s emitted per atom in 4𝜋

Imaging time 10us 103 𝛾/10us/atom emitted in 4𝜋

  • For F10 object side system for each individual view, we can find the ratio of the solid angle in 4𝜋
  • Angle ratio = ( 𝜋 r2 / d2 ) / 4*4𝜋 ~ 6 10-4 [NB 2r/d =1/10]
  • 103 * angle_ratio = 0.6 𝛾/10us/atom/view

  • 40x40x40 voxel space, individual views are 40x40 bins
  • Assume 1mm cloud, and 10 equal fringes per cloud, 4x40 pixels per cycle (sin2), head-on view:
  • 106 atoms 105 atoms/cycle 4 104 /40 atoms in one bright pixel & 9/40 103 atoms in one low pixel

500 - 100 𝛾/10us in one pixel of the given view

  • Contrast ratio of 2 pixels from sin2 64% contrast ratio
  • For 5 fringes → 300 - 15 𝛾/10us in one pixel of the given view & 90% contrast ratio
  • NB actual number of atoms in each fringe changes the number of photons, not contrast ratio

Do these numbers look reasonable?

Can we get away with 5 fringes per cloud instead of 10?

(ie, Period of one full oscillation (0 to 𝜋 for sin2) = 200um)

27

28 of 30

Stanford Prototype - Camera 1

  • Zero amp glow, low noise CMOS camera
  • O(10-8) e/px from dark current for 10us imaging
  • 1-4 e/px from Readout Noise
  • 5 sigma above noise is ~ 14 e/px

⟶ 18𝜸/px should be good with QE ~ 80%

  • Electric rolling shutter

⟶ Potentially need to image for O(ms) to insure we’re simulating global shutter - Low FPS imaging

28

EM: 80000e

∼82% @ 461 mm

1.0e-3.7e

Dual Stage TEC

2GB PRO, 1GB(8b) PH/L

/Fibre Port PRO 2*10Gb/s

FPS 2.5 PH/ 4 PRO

Exposure Range: 40μs-3600s

Zero Amp Glow Circuitry

29 of 30

Camera Numbers

QHY600M PRO/PH/L

29

“QHY600 Performance Curves in Readout Mode #0 (Photographic Mode). In this mode there is a drop in the noise between Gain 25 and Gain 26. We recommend setting the Gain to 26 to begin. At this setting the full well is 27ke- and readout noise is 2.7e-. For every long exposures you can lower the gain from this point to increase the full well capacity.

QHY600 Performance Curves in Readout Mode #1 (High Gain Mode). Please note there is a HGC/LGC switch point at gain55 to gain56. Gain0-55 uses LGC and Gain55-100 uses HGC.

QHY600 Performance Curves in Readout Mode #2 (Super Fullwell Mode).

Now QHY600 adds #3 mode Extend Fullwell 2CMSIT (yellow curve). The advantage of this mode is that it has the same full well value and system gain as the #2 mode Extend Fullwell, but the read noise is reduced by about 1.3 times”

30 of 30

Camera Decision

QHY600M PRO

  • Larger DDR3 buffer @ 16 bit
  • “It has more flexible triggering so you should have an easier time integrating it with EPICS control and synchronizing it with other aspects of your experimental setup, and the frame rate and data transfer rates are higher than the other model”
  • PRO supports 2 x 10 Gigabit Optical Fiber ports. Faster, high stability, allows for long transfer distance (up to 300 meters).

30