Papers
- Ma, Lewis, Kleijn
TrailBlazer: Trajectory Control for Diffusion-Based Video Generation.
project page + videos,
arxiv
- Ma et al,
Directed Diffusion : Direct Control of Object Placement through Attention Guidance,
AAAI 2024
(preprint with included supplementary)
arxiv
- Elcott, Lewis, Kanazawa, Bregler,
Training-Free Neural Matte Extraction for Visual Effects,
SIGGRAPH Asia 2022 Technical Communications.
slightly expanded arxiv version
- Tan et al.,
NewsStories: Illustrating Articles with Visual Summaries,
ECCV 2022.
- Ma, Lewis, Kleijn,
The HSIC Bottleneck: Deep Learning without Back-Propagation,
AAAI 2020
conference link,
pdf,
arxiv
- Deng, Lewis, Jeruzalski, Pons-Moll, Hinton, Norouzi, Tagliasacchi,
NASA: Neural Articulated Shape Approximation,
ECCV 2020
ECCV conference link,
google,
arxiv,
video
- Lahiri et al,
LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization
,
CVPR 2021.
video,
blog post
- Binh Le, Lewis,
Direct Delta Mush Skinning and Variants, ACM TOG/SIGGRAPH 2019
- Angles et al,
VIPER: Volume Invariant Position-based Elastic Rods
SCA 2019
(video,
two minute papers)
- Binh Le, Halen, Gonzalez-Ochoa, Lewis,
High-Quality ObjectSpace Dynamic Ambient Occlusion for Characters using Bi-level Regression
I3D 2019
- Roberts, Lewis et al.,
Optimal and Interactive Keyframe Selection for Motion Capture
,
Computational Visual Media (journal version of Roberts et al. 2018)
preprint,
SIGGRAPH Asia,
video,
maya source from R.Roberts
- Lamarre, Lewis, Danvoye,
Face Stabilization by Mode Pursuit for Avatar Construction in the Universe,
Image Vision Computing 2018 (best presentation award)
- Dean, Lewis, Chalmers,
A Magic Wand for Motion Capture Editing and Edit Propagation,
SIGGRAPH Asia technical communications 2018
- Roberts, Lewis, Anjyo, Seo, Seol,
Optimal and Interactive Keyframe Selection for Motion Capture, SIGGRAPH Asia technical communications 2018
- Campbell, Lewis, Seol,
Sequence Alignment with the Hilbert-Schmidt Independence Criterion,
CVMP 2018
- Balduzzi et al.,
The Shattered Gradients Problem: If resnets are the answer, then what is the question?
ICML 2017 (also best paper award ICML padl :)
- Cetinaslan, Lewis, Orvalho,
Transposition Based Blendshape Direct Manipulation,
GRAPP 2017 (Best paper award).
- Blanco i Ribera, Zell, Lewis, Noh, Botsch,
Facial Retargeting with Automatic Range of Motion Alignment,
SIGGRAPH/ACM Transaction on Graphics 2017.
(video)
- Song, Blanco i Ribero et al.,
Sparse Rig Parameter Optimization for Character Animation"
EUROGRAPHICS 2017 and Computer Graphics Forum
youtube
- Ma, Ghifary, Lewis, Choi, Eom,
FDLS: A Deep Learning Approach to Production Quality, Controllable, and Retargetable Facial Performances,
ACM Digital Production Symposium 2022.
author copy,
video
- Choi, Blanco i Ribera, Lewis, Seol, Hong, Eom, Jung, Noh,
SketchiMo: sketch-based motion editing for articulated characters,
SIGGRAPH/ACM Transaction on Graphics 2016
youtube
- Seol, Ma, Lewis,
Creating an Actor-specific Facial Rig from Performance Capture,
ACM Digipro 2016.
- Migalska, Lewis,
An Information Theoretic Approach to Reflectional Symmetry Detection, IVCNZ 2015.
(preprint)
- Lewis, Realism and Texture: Benchmark Problems for Natural Computation,
Unconventional Computation and Natural Computation (UCNC) 2015.
-
Lewis et al.,
Practice and Theory of Blendshape Facial Models,
Eurographics 2014 STAR course notes
(preprint)
-
Lewis, Anjyo, Rhee,
Superresolution from Principal Component Models by RKHS Sampling,
Proceedings of the Mathematical Progress in Expressive Image Synthesis Symposium (MEIS 2014).
(preprint)
-
Lewis, Anjyo, Mo, Rhee,
Probable and Improbable Faces,
Proceedings of the Mathematical Progress in Expressive Image Synthesis Symposium (MEIS 2013).
(preprint)
-
Chalmers, Lewis, Hillman, Tait, Rhee,
Sky Browser: Search for HDR Sky Maps,
Pacific Graphics 2014
-
Roberts, Jones, Lewis,
Synthesis of Incidental Detail Using Higher Order Functions and Free Monads, IVCNZ 2013
-
Yeongho Seol, Jaewoo Seo, Paul Hyunjin Kim, J.P. Lewis, Junyong Noh,
->
(preprint)
Weighted Pose Space Editing for Facial Animation
Visual Computer, 2012.
Conference version:
Seol, Seo, Kim, Lewis, Noh,
Pose Space Editing of Blendshape Based Facial Animation,
CGI 2011
-
Seol, Lewis, Seo, Noh,
Spacetime Expression Cloning for Blendshapes,
ACM Transactions on Graphics, 31, 2, 2012
-
Calude, Lewis,
Is there a Universal Image Generator?,
Applied Mathematics and Computation, vol 218, #16, 2012.
(preprint)
-
Ma, Barbati, Lewis,
A Facial Composite Editor for Blendshape Characters,
ACM Digital Production Symposium 2012, 21-26
- Baker, Scharstein, Lewis, Roth, Black, Szeliski,
A Database and Evaluation Methodology for Optical Flow,
International Journal of Computer Vision, 92, 1, 2011
(project page)
-
Jaewoo Seo, Geoffrey Irving, J.P. Lewis, Junyong Noh,
Compression and Direct Manipulation of Complex Blendshape Models
ACM Transaction On Graphics, vol 30, #6, 2011
(also ACM SIGGRAPH ASIA, 2011).
(preprint)
-
Yeongho Seol, Jaewoo Seo, Paul Hyunjin Kim, J.P. Lewis, Junyong Noh,
Artist Friendly Facial Animation Retargeting
ACM Transaction On Graphics, vol 30, #6, 2011
(also ACM SIGGRAPH ASIA, 2011).
-
Lewis, Sylwan,
Edge-Aware Inpainting using Oriented (Bi)Harmonic Interpolation,
CGI 2011
-
Anjyo, Lewis,
RBF Interpolation and Gaussian Process Regression through an RKHS Formulation,
JMI Volume 3 2011.
-
Rhee, Lewis, Neumann,
Scan-Based Volume Animation Driven by Locally Adaptive Articulated Registrations,
IEEE Trans. Visualization and Computer Graphics, March 2011
(project page)
-
Lewis, Anjyo
Direct Manipulation Blendshapes,
IEEE Computer Graphics and Applications 30(4)
Special Issue: Digital Human Faces
(project page)
-
A. Lagae, S. Lefebvre, R. Cook, T. DeRose, G. Drettakis, D.S. Ebert, J.P. Lewis, K. Perlin, M. Zwicker,
A Survey of Procedural Noise Functions,
Computer Graphics Forum 29, 8, 2010;
also
Eurographics 2010 State of the Art Report: Procedural Noise Functions
(local copy)
-
Sips, Neubert, Lewis, Hanrahan,
Selecting Good Views of High-Dimensional Data using Class Consistency,
Computer Graphics Forum Vol. 28 #3
(Special issue: Eurovis 2009)
-
Sun, Roth, Lewis, Black,
Learning Optical Flow,
Lecture Notes in Computer Science 5304 2008
-
West, Lewis, Margolis, Schulze, Gossmann, Tenedorio, Singh,
Algorithmic Object As Natural Specimen: Meta Shape Grammar Objects From Atlas In Silico,
Leonardo.
-
Lewis, Mostafavi, West, Sosinsky, Martone,
Shape Priors by Kernel Density Modeling of PCA Residual Structure,
IEEE International Conference on Image Processing 2007
-
Lewis,McGuire,Fox,
Mapping the Mental Space of Game Genres,
ACM SIGGRAPH Symp. Video Games 2007
-
Rhee, Lewis, Neumann, Nayak,
Soft-tissue Deformation for In Vivo Volume Animation,
Pacific Graphics 07
-
Lewis,Anjyo,
A Region-of-Influence Measure for Automatic Skinning,
IVCNZ 07
-
Baker, Scharstein, Lewis, Roth, Black, Szeleski,
A Database and Evaluation Methodology for Optical Flow., ICCV 07.
-
Lewis, Mooser, Deng, Neumann,
A User Interface Technique for Controlling Blendshape Interference,
in Data-Driven 3D Animation, Springer, 2007.
Deng, Lewis, Neumann
Realistic Eye Motion Synthesis by Texture Synthesis,
in Data-Driven 3D Animation, Springer, 2007.
-
T. Rhee, J.P. Lewis, U. Neumann,
"Real-Time Weighted Pose-Space Deformation on the GPU",
Computer Graphics Forum, Vol 25, No 3, (Eurographics 2006).
-
Xiao Xian, Lewis, Soon, Fong, Feng,
A Powell Optimization Approach for Example-Based
Skinning in a Production Animation Environment,
(pdf)
Computer Animation and Social Agents (CASA 2006)
-
Rhee, Neumann, Lewis,
Human Hand Modeling from Surface Anatomy (preprint),
Proc. ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games 2006 (I3D),
Redwood City, CA, March 2006
-
Lewis, Fong, XueXian, Soon, Feng,
More Optimal Strokes for NPR Sketching,
ACM Graphite 2005.
-
Lewis, Mooser, Deng, Neumann,
Reducing Blendshape Interference by Selected Motion Attenuation,
ACM I3D 2005.
(project page)
-
Deng, Lewis, Neumann,
Automated Eye Motion Using Texture Synthesis,
IEEE Computer Graphics and Applications, March/April 2005.
-
Mo, Lewis, Neumann,
SmartCanvas: A Gesture-Driven Intelligent Drawing Desk System,
Proc. of International Conference on Intelligent User Interface (IUI) 2005
-
West, Burke, Kerfeld, Mendelowitz, Holton, Lewis, Drucker, Yan, Both and Neither: in silico v1.0, Ecce Homology. Leonardo, 38 (4) 2005
-
Lewis, Rosenholtz, Fong, Neumann,
VisualIDs: Automatic Distinctive Icons for Desktop Interfaces,
ACM SIGGRAPH 2004.
-
Mo, Lewis, Neumann,
Face Inpainting with Local Linear Representations,
BMVC 2004.
-
Lewis, Hwang, Neumann, Enciso,
Smart point landmark distribution for thin-plate splines,
SPIE Medical Imaging 2004.
-
Large Limits to Software Estimation,
ACM Software Engineering Notes 26, No. 4, July 2001, p. 54-59
-
Lewis, Cordner, Fong,
Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation,
Siggraph 2000.
-
"Fast Template Matching",
Vision Interface 1995
(expanded/corrected version).
-
Lewis, Ott, Cox,
VideoConferencing System using a Virtual Camera Image.
U.S. Patent No. 5,359,362 (1994);
also
Ott, Lewis and Cox,
Teleconferencing Eye Contact Using a Virtual Camera",
Interchi'93 Proceedings, 109-110, Amsterdam, (1993).
-
Automated Lip-Sync: Background and Techniques,
J. Visualization and Computer Animation, 2, 1991
pdf
-
Probing the Critic: Approaches to Connectionist Pattern Synthesis.
International Joint Conference on Neural Networks 91, Seattle.
-
Texture and Shape Generation by Neural Network Creation Paradigm.
Graphics Interface 91.
(pdf, missing some figures)
-
Creation by Refinement and the Problem of Algorithmic Music Composition,
in Music and Connectionism, P.Todd, ed., MIT Press, 1991.
-
Apparatus and Method for Lip-Synching Animation
U.S. Patent No. 4,913,539, Apr.3,90.
-
Algorithms for Solid Noise Synthesis, Siggraph 89.
(pdf,
html preview)
-
Algorithms for Music Composition by Neural Nets: Improved CBR Paradigms,
International Computer Music Conference 89.
-
Creation by Refinement: A Creativity Paradigm for Gradient Descent Learning Networks. International Conference on Neural Networks 88.
-
Generalized stochastic subdivision,
ACM Transactions on Graphics July 1987.
-
Lewis, Parke,
Automated lip-synch and speech synthesis for character animation,
CHI+GI 87.
(video.ogg)
(video.mp4 - OPEN WITH VLC does not play in browser)
Short Papers and Abstracts
- Roberts et al.,
Piku Piku Interpolation:
An artist-guided sampling algorithm for synthesizing detail applied to facial animation
SIGGRAPH Asia '19 (short paper)
- Nghiem et al.,
Saliency Diagrams: A tool for analyzing animation through the relative importance of keyposes
SIGGRAPH Asia '19 (short paper)
- Lewis, Yeh, Migalska, Johnson, West,
Exploring the definition of art through deep net visualization,
NIPS IEVDL 2017.
- Ma, Lewis, Frean, Balduzzi
Back To RGB: Deep Articulated Hand Pose Estimation From a Single Camera Image
,
Image Vision Computing
- Dean, Lewis,
Non-local Pose Means for Denoising Motion Capture Data,
Image Vision Computing
(preprint)
(video)
- Patrikeev, Lewis,
Texture-aware Edit Propagation using Nonparametric Regression,
Image Vision Computing 2015.
- Cetinaslan, Orvalho, Lewis,
Sketch-Based Controllers for Blendshape Facial Animation,
Eurographics} 2015.
-
Calude, Coull, Lewis,
Can We Solve the Pipeline Problem? ACM Digipro 2014
(preprint)
-
Seol, Lewis, Tuning Facial Animation in a Mocap Pipeline,
ACM SIGGRAPH 2014 Talk
-
Seo, Lewis, Developing Interactive Facial Rigs in Production Environment,
ACM SIGGRAPH 2014 Talk
-
Anjyo, Todo, Lewis,
A Practical Approach to Direct Manipulation Blendshapes,
Journal of Graphics Tools 16, 3, 2012
- Lewis, Dragosavac,
Stable and Efficient Differential IK,
ACM SIGGRAPH Asia 2010
- G. Stanley, M. J. Black, J.P. Lewis, G. Desbordes, J. Jin, J.-M. Alonso,
Population coding of ground truth motion in natural scenes in the early visual system,
COSYNE, 2009.
- Lewis, Anjyo,
Identifying Salient Points, SIGGRAPH Asia 2009.
- Lewis, Anjyo,
Extracting Higher-Level Information From Facial Mocap,
SIGGRAPH 2008.
-
Rhee, Lewis, Neumann, Nayak,
Creating an Animatable 3D Volume Hand Model
from In Vivo MRI, MMVR16 2008.
- West, Margolis, Mostafavi, Lewis, Gossmann, Hackbarth, Horn, Fernald, Schulze, Li, Henthorn, Yamada, Singh, Chheng, Cassey, Lien, ATLAS in silico, ACM SIGGRAPH 2007 Art Gallery, (Invited exhibition / Interactive installation)
- Lewis, Fox, Deng,
A Methodology for Mapping the Mental Space of Game Genres,
ACM Sandbox Video Game Symposium 2006.
-
West, Burke, Mendelowitz, Lewis, Kerfeld,
ACTG to Calligraphy: Genetic Visualization for Ecce Homology,
Infovis 06 poster.
-
Z. Mo, J.P.Lewis, and U. Neumann,
Improved Automatic Caricature by Feature Normalization and Exaggeration,
SIGGRAPH 2004 Sketches and Applications.
- West, Burke, Kerfeld, Mendelowitz, Holton, Lewis, Drucker, Yan,
Ecce Homology, Siggraph 2004 Design Sketch.
-
Realistic Human Face Rendering for "The Matrix Reloaded",
George Borshukov and J.P.Lewis,
SIGGRAPH-2003 Sketches and Applications Program,
San Diego, CA: ACM SIGGRAPH, July (2003).
-
Universal Capture - Image-based Facial Animation for "The Matrix Reloaded",
George Borshukov, Dan Piponi, Oystein Larsen, J.P.Lewis, Christina Tempelaar-Lietz,
SIGGRAPH-2003 Sketches and Applications Program,
San Diego, CA: ACM SIGGRAPH, July (2003).
-
Z. Deng, J.P.Lewis, and U. Neumann,
Practical Eye Movement Model using Texture Synthesis,
SIGGRAPH 2003 Sketches and Applications,
San Diego, CA: ACM SIGGRAPH, July (2003).
-
R.Enciso, J.Mah, J.P.Lewis, U.Neumann,
"3D Tooth Shape from Radiographs Using Thin-Plate Splines" (poster)
11th annual "Medicine Meets Virtual Reality" conference 2003,
IOS Press
-
Lifting Detail from Darkness
Siggraph 2001 Tech Sketch
slides
-
Decomposing Animation into Blendshapes,
Siggraph 2001 Tech Sketch
-
"R&D into Production: The Dark Side",
Siggraph 2001 course (R&D into Production).
Pdfs
Course Notes
Presentations
Other
- credits on Forrest Gump, Matrix Reloaded & Revolutions, Avatar, Planet of the Apes trilogy
- Film restoration credit on The Little Mermaid 2006 rerelease
- Vision programmer, Disney Human Face project
- Co-founder ACM Digipro conference
|
Contact
JP Lewis
|