You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: viscomp/viscomp.tex
+4-5
Original file line number
Diff line number
Diff line change
@@ -64,6 +64,7 @@
64
64
65
65
% To include sketches & PDFs
66
66
\usepackage{graphicx}
67
+
\usepackage{float}
67
68
68
69
% For hyperlinks
69
70
\usepackage{hyperref}
@@ -289,6 +290,7 @@ \subsection{JPG}
289
290
JPEG2000 achieves better results by using the Haar transform globally, not just \( 8 \times 8 \), on a successively downsampled image.
290
291
291
292
\subsection{Optical Flow}
293
+
\subsubsection{Applications} Frame extrapolation, frame interpolation, video compression (exploit temp. red.), structure from motion, object tracking, video stabilization (aim at OF \(\approx 0 \))
292
294
\textbf{Brightness Constancy}
293
295
\begin{align*}
294
296
I(x,y,t) &= I(x+ \delta x, y + \delta y, t + \delta t) \\
Has errors at boundaries, information spreads from corner-type patterns
306
-
\subsubsection{Applications} Frame extrapolation, frame interpolation, video compression (exploit temp. red.), structure from motion, object tracking, video stabilization (aim at OF \(\approx 0 \))
307
308
\subsubsection{Lucas-Kanade} Assume all neighbouring pixels in a patch \( W \) observer the same motion \(\left[ u,v \right]^\top\) (+ small movement, brightness constancy). Compute \( I_x, I_y, I_t \) and minimize \[ E = \sum_{(x,y)\in W} (I_x(x,y)u + I_y(x,y)v + I_t(x,y))^2 \] Solve least squares (sums are over patch \( W \)):
308
309
\[
309
310
\left[
@@ -336,7 +337,6 @@ \subsubsection{Iterative refinement} Obtain more exact estimate of optical flow:
336
337
\end{enumerate}
337
338
Fails if intensity structure poor or large displacement.
338
339
\subsubsection{Coarse-to-fine pyramids} Create multiple levels by gradual subsampling of the image. Start with coarsest level, estimate OF. Gradually use aggregated OF estimate as initial estimate of the OF in the next finer level and estimate again with Lucas-Kanade. Iterate until finest level. This still fails if large lighting change happens.
339
-
\subsubsection{Applications} Frame extra-/interpolation, video compression, object tracking, video stabilization (aim for OF \(\approx 0 \))
340
340
341
341
\subsection{Video Compression}
342
342
\subsubsection{Bloch's law} If stimulus duration \(\le\qty{100}{\milli\second}\), we can exchange duration for brightness and vice-versa, e.g. if brightness of stimulus is halved, double the duration \(\rightarrow\) can still be detected. This enforces \( > \qty{10}{\hertz} \) for videos
@@ -346,7 +346,7 @@ \subsubsection{Temporal redundancy} exploit temp. red. by predicting current fra
346
346
\item\textit{P-Frame} -- predictively coded frame based on previously coded I- and P-frames
347
347
\item\textit{B-Frame} -- bi-directionally predicted frame, coded based on both previous and future frames
348
348
\end{itemize}
349
-
This is ineffective if there are many scene changes and/or high motion
349
+
This is ineffective if there are many scene changes and/or high motion
350
350
351
351
\subsubsection{Motion-compensated prediction} use if temp. red. fails Generally very difficult, pratical: \textit{block-matching motion estimation}. Partition each frame into blocks and describe motion by finding best matching block in reference frame
352
352
@@ -552,14 +552,13 @@ \subsubsection{Gouraud shading} Linear interpolation of vertex intensities, in s
552
552
Problems with scan line interpolations are perspective distortion, orientation dependence and shared vertices. Quality depends on primitive size
553
553
554
554
\subsubsection{Phong shading} Barycentric interpolation of vertex normals, in object space
0 commit comments