Victoria Kostina
About Me 

I am a Professor of Electrical Engineering at Caltech. Prior to joining Caltech in the fall of 2014, I had received a Bachelor's degree from Moscow Institute of Physics and Technology, where I was affiliated with the Institute for Information Transmission Problems of the Russian Academy of Sciences, a Master's degree from University of Ottawa, and a PhD degree from Princeton University. I spent the spring of 2015 as a Research Fellow at Simons Institute for the Theory of Computing. I received the 2013 Princeton Electrical Engineering Best Dissertation Award and the 2017 NSF CAREER award. My research interests lie in information theory, theory of random processes, coding, wireless communications, learning, and control. I am particularly interested in fundamental limits of delaysensitive communications.

Openings
I am looking for strong students and postdocs to join my research group.
Prospective students: I apologize I am unable to respond to all inquiries — please do apply online and mention my name as a possible research advisor. I supervise students from the Computing and Mathematical Sciences (CMS), Control and Dynamical Systems (CDS), and Electrical Engineering (EE) PhD programs.
Prospective postdocs: please apply through the Center for the Mathematics of Information (CMI) postdoctoral fellowship program and mention my name in the application.
Research
Preprints
 O. Sabag, V. Kostina, B. Hassibi, "Feedback capacity of MIMO Gaussian channels", arXiv:2106.01994, video, slides, June 2021.
 C. Lin, V. Kostina, B. Hassibi, "Differentially quantized gradient methods", arXiv:2002.02508, June 2020.
 R. C. Yavas, V. Kostina, M. Effros, "Variablelength feedback codes with several decoding times for the Gaussian channel", arXiv:2103.09373, video, slides, Mar. 2021.
 N. Guo, V. Kostina, "Optimal causal rateconstrained sampling for a class of continuous Markov processes", arXiv:2002.01581, video, slides, Feb. 2020.
 V. Kostina, B. Hassibi, "Fundamental limits of distributed tracking", arXiv:1910.02534, video, slides, June 2020.
 V. Kostina, Y. Peres, G. Ranade, and M. Sellke, "Exact minimum number of bits to stabilize a linear system ," arXiv:1807.07686, July 2018.
Journal Articles
 F. Lahouti, V. Kostina and B. Hassibi, "How to query an oracle? Efficient strategies to label data", IEEE Transactions on Pattern Analysis and Machine Intelligence, online ISSN: 01628828, print ISSN: 01628828, digital object identifier: 10.1109/TPAMI.2021.3118644, Oct. 2021.
 R. C. Yavas, V. Kostina, M. Effros, "Gaussian multiple and random access channels: finiteblocklength analysis", IEEE Transactions on Information Theory, vol. 67, no. 11, pp. 69837009, video, slides, Nov. 2021.
 V. Kostina, B. Hassibi, "The CEO problem with interblock memory", IEEE Transactions on Information Theory, online ISSN: 15579654, print ISSN: 00189448, digital object identifier: 10.1109/TIT.2021.3111658, Sep. 2021.
 P. Noorzad, M. Effros, M. Langberg, V. Kostina, "The Birthday Problem and ZeroError List Codes", IEEE Transactions on Information Theory, vol. 67, no. 9, pp. 57915803, Sep. 2021.
 M. Effros, V. Kostina and R. C. Yavas, "Random access channel coding in the finite blocklength regime", IEEE Transactions on Information Theory, vol. 67, no. 4, pp. 21152140, Apr. 2021.
 P. Tian and V. Kostina, "Nonstationary GaussMarkov processes: Parameter estimation and dispersion", IEEE Transactions on Information Theory, vol. 67, no. 4, pp. 24262449, Apr. 2021.
 V. Kostina, Y. Peres, G. Ranade, M. Sellke, "Stabilizing a system with an unbounded random gain using only finitely many bits", IEEE Transactions on Information Theory, vol. 67, no. 4, pp. 25542561, Apr. 2021.
 M. Ebrahimi, F. Lahouti and V. Kostina, "Two layer coded channel access with collision resolution: Design and Analysis", IEEE Transactions on Wireless Communications, vol. 19, no. 12, pp. 79867997, Dec. 2020.
 N. Guo, V. Kostina, "Optimal causal rateconstrained sampling of the Wiener process", IEEE Transactions on Automatic Control, May 2020.
 S. Chen, M. Effros, V. Kostina, "Lossless source coding in the pointtopoint, multiple access, and random access scenarios", IEEE Transactions on Information Theory, vol. 66, no. 11, pp. 66886722, Nov. 2020.
 P. Tian and V. Kostina, "The dispersion of the GaussMarkov source", IEEE Transactions on Information Theory, vol. 65, no. 10, pp. 63556384, Oct. 2019.
 V. Kostina and E. Tuncel, "Successive refinement of abstract sources", IEEE Transactions on Information Theory, vol. 65, no. 10, pp. 63856398, Oct. 2019.
 V. Kostina and B. Hassibi, "Ratecost tradeoffs in control", IEEE Transactions on Automatic Control, vol. 64, no. 11, pp. 45254540, Nov. 2019.
 A. Khina, E. Riedel Garding, G. M. Petterson, V. Kostina, and B. Hassibi, "Control over Gaussian channels with and without sourcechannel separation", IEEE Transactions on Automatic Control, vol. 64, no. 9, pp. 36903705, Apr. 2019.
 A. Khina, A. Khisti, V. Kostina, and B. Hassibi, "Tracking and control of GaussMarkov processes over packetdrop channels with acknowledgements", IEEE Transactions on Control of Network Systems, vol. 6, no. 2, pp. 549580, June 2019.
 A. Marsiglietti and V. Kostina, "A lower bound on the differential entropy of logconcave random vectors with applications" , PDF, Entropy (Special Issue Entropy and Information Inequalities), vol. 20, no. 3, Mar. 2018.
 V. Kostina, "Data compression with low distortion and finite blocklength", IEEE Transactions on Information Theory, vol. 63, no. 7, pp. 42684285, July 2017.
 V. Kostina, Y. Polyanskiy and S. Verdú, "Joint sourcechannel coding with feedback", IEEE Transactions on Information Theory, vol. 63, no. 6, pp. 35023515, June 2017.
 V. Kostina and S. Verdú, "Nonasymptotic noisy lossy source coding", IEEE Transactions on Information Theory, vol. 62, no. 11, pp. 61116123, Nov. 2016.
 V. Kostina, Y. Polyanskiy and S. Verdú, "Variablelength compression allowing errors", IEEE Transactions on Information Theory, vol. 61, no. 9, pp. 43164330, Aug. 2015.
 V. Kostina and S. Verdú, "Channels with cost constraints: strong converse and dispersion", IEEE Transactions on Information Theory, vol. 61, no. 5, pp. 24152429, May 2015.
 S. Loyka, V. Kostina, and F. Gagnon, "On convexity of error rates in digital communications", IEEE Transactions on Information Theory, vol. 59, no. 10, pp. 65016516, Oct. 2013.
 V. Kostina and S. Verdú, "Lossy joint sourcechannel coding in the finite blocklength regime", IEEE Transactions on Information Theory, vol. 59, no. 5, pp. 25452575, May 2013.
 V. Kostina and S. Verdú, "Fixedlength lossy compression in the finite blocklength regime", IEEE Transactions on Information Theory, vol. 58, no. 6, pp. 33093338, June 2012.
 V. Kostina and S. Loyka, "Optimum power and rate allocation for coded VBLAST: instantaneous optimization", IEEE Transactions on Communications, vol. 59, no. 10, pp. 28412850, Oct. 2011.
 V. Kostina and S. Loyka, "Optimum power and rate allocation for coded VBLAST: average optimization", IEEE Transactions on Communications, vol. 59, no. 3, pp. 877887, Mar. 2011.
 S. Loyka, V. Kostina, and F. Gagnon, "Error rates of the maximumlikelihood detector for arbitrary constellations: convex/concave behavior and applications", IEEE Transactions on Information Theory, vol. 56, no. 4, pp. 19481960, Apr. 2010.
 V. Kostina and S. Loyka, "On optimum power allocation for the VBLAST", IEEE Transactions on Communications, vol. 56, no. 6, pp. 9991012, June 2008.
Ph.D. Dissertation
 V. Kostina, "Lossy data compression: nonasymptotic fundamental limits", Ph.D. dissertation, Princeton University, Sep. 2013. Princeton Electrical Engineering Best Dissertation Award.
Conference Papers
 O. Sabag, V. Kostina, B. Hassibi, "Feedback capacity of MIMO Gaussian channels", in Proceedings 2021 IEEE International Symposium on Information Theory, pp. 712, video, slides, July 2021.
 R. C. Yavas, V. Kostina, M. Effros, "Variablelength feedback codes with several decoding times for the Gaussian channel", in Proceedings 2021 IEEE International Symposium on Information Theory, pp. 18831888, video, slides, July 2021.
 C. Lin, V. Kostina, B. Hassibi, "Differentially quantized gradient descent", in Proceedings 2021 IEEE International Symposium on Information Theory, pp. 12001205, video, slides, July 2021.
 N. Guo, V. Kostina, "Instantaneous SED coding over a DMC", in Proceedings 2021 IEEE International Symposium on Information Theory, pp 148153, video, slides, July 2021; J K. Wolf ISIT Student Paper Award Finalist.
 O. Sabag, P. Tian, V. Kostina, B. Hassibi, "The minimal directed information needed to improve the LQG cost", in Proceedings 2020 IEEE Conference on Decision and Control, Dec. 2020, to appear.
 V. Kostina, B. Hassibi, "Fundamental limits of distributed tracking", in Proceedings 2020 IEEE International Symposium on Information Theory, video, slides, June 2020.
 O. Sabag, V. Kostina, B. Hassibi, "Stabilizing dynamical systems with fixedrate feedback using constrained quantizers", in Proceedings 2020 IEEE International Symposium on Information Theory, video, slides, June 2020.
 N. Guo, V. Kostina, “Optimal causal rateconstrained sampling for a class of continuous Markov processes", in Proceedings 2020 IEEE International Symposium on Information Theory, video, slides, June 2020.
 R. C. Yavas, V. Kostina, M. Effros, "Gaussian multiple and random access in the finite blocklength regime", in Proceedings 2020 IEEE International Symposium on Information Theory, video, slides, June 2020.
 N. Guo and V. Kostina, "Optimal causal rateconstrained sampling of the Wiener process", in Proceedings 57th Annual Allerton Conference on Communication, Control and Computing, Monticello, IL, Oct. 2019.

V. Kostina, "Rate loss in the Gaussian CEO problem", in Proceedings 2019 IEEE Information Theory Workshop, Visby, Gotland, Sweden, Aug. 2019.
 S. Chen, M. Effros, V. Kostina, "Lossless source coding in the pointtopoint, multiple access, and random access scenarios", in Proceedings 2019 IEEE International Symposium on Information Theory, Paris, France, July 2019.

P. Tian, V. Kostina, "From parameter estimation to dispersion of nonstationary GaussMarkov processes", in Proceedings 2019 IEEE International Symposium on Information Theory, Paris, France, July 2019.

A. Lalitha, A. Khina, T. Javidi, V. Kostina, "Realtime binary posterior matching", in Proceedings 2019 IEEE International Symposium on Information Theory, Paris, France, July 2019.
 V. Kostina, Y. Peres, G. Ranade, and M. Sellke, "Exact minimum number of bits to stabilize a linear system," in Proceedings 57th IEEE Conference on Decision and Control, Miami, FL, Dec. 2018, pp. 453458.

V. Kostina and B. Hassibi, "Ratecost tradeoffs in scalar LQG control and tracking with side information", in Proceedings 56th Annual Allerton Conference on Communication, Control and Computing, Monticello, IL, Oct. 2018, pp. 421428.
 M. Effros, V. Kostina and R. C. Yavas, "Random access channel coding in the finite blocklength regime", in Proceedings 2018 IEEE International Symposium on Information Theory, Vail, Colorado, June 2018, pp. 12611265.
 P. Tian and V. Kostina, "The dispersion of the GaussMarkov source", in Proceedings 2018 IEEE International Symposium on Information Theory, Vail, Colorado, June 2018, pp. 14901494.
 A. Marsiglietti and V. Kostina, "New connections between the entropy power inequality and geometric inequalities", in Proceedings 2018 IEEE International Symposium on Information Theory, Vail, Colorado, June 2018, pp. 19781982
 V. Kostina, Y. Peres, G. Ranade and M. Sellke, "Stabilizing a system with an unbounded random gain using only finitely many bits", in Proceedings 2018 IEEE International Symposium on Information Theory, Vail, Colorado, June 2018, pp. 22562260.
 Y. Nakahira, F. Xiao, V. Kostina, J. C. Doyle, "Fundamental limits and achievable performance in biomolecular control", in Proceedings 2018 American Control Conference, Milwaukee, WI, June 2018, pp. 27072714.
 A. Khina, V. Kostina, A. Khisti, and B. Hassibi, "Sequential coding of GaussMarkov sources with packet erasures and feedback," in Proceedings 2017 IEEE Information Theory Workshop, Kaohsiung, Taiwan, Nov. 2017, pp. 529530.
 M. Ebrahimi, F. Lahouti, V. Kostina, "Coded random access design for constrained outage", in Proceedings 2017 IEEE International Symposium on Information Theory, Aachen, Germany, June 2017, pp. 27322736.
 V. Kostina and E. Tuncel, "The ratedistortion function for successive refinement of abstract sources," in Proceedings 2017 IEEE International Symposium on Information Theory, Aachen, Germany, June 2017, pp. 19231927.
 A. Marsiglietti and V. Kostina, "A lower bound on the differential entropy for logconcave random variables with applications to ratedistortion theory", in Proceedings 2017 IEEE International Symposium on Information Theory, Aachen, Germany, June 2017, pp. 4650.
 P. Noorzad, M. Effros, M. Langberg, V. Kostina, "The birthday problem and zeroerror list codes", in Proceedings 2017 IEEE International Symposium on Information Theory, Aachen, Germany, June 2017, pp. 16481652.
 A. Khina, G. M. Pettersson, V. Kostina, and B. Hassibi, "Multirate control over AWGN channels: an analog joint sourcechannel coding perspective" ,in Proceedings 2016 IEEE Conference on Decision and Control, Las Vegas, NV, Dec. 2016, pp. 59685973.
 V. Kostina, “When is Shannon’s lower bound tight at finite blocklength?”, in Proceedings 54th Annual Allerton Conference on Communication, Control and Computing, Monticello, IL, Oct. 2016, pp. 982989.
 V. Kostina and B. Hassibi, “Ratecost tradeoffs in control”, in Proceedings 54th Annual Allerton Conference on Communication, Control and Computing, Monticello, IL, Oct. 2016, pp. 11571164.
 V. Kostina, Y. Peres, M. Z. Rácz, G. Ranade, “Ratelimited control of systems with uncertain gain”, in Proceedings 54th Annual Allerton Conference on Communication, Control and Computing, Monticello, IL, Oct. 2016, pp. 11891196.
 V. Kostina, "Data compression with low distortion and finite blocklength", in Proceedings 53rd Annual Allerton Conference on Communication, Control and Computing, Monticello, IL, Oct. 2015, pp. 11271134.
 V. Kostina, Y. Polyanskiy and S. Verdú, "Joint sourcechannel coding with feedback", in Proceedings 2015 IEEE International Symposium on Information Theory, Hong Kong, June 2015, pp. 276280.
 V. Kostina, Y. Polyanskiy and S. Verdú, "Transmitting k samples over the Gaussian channel: energydistortion tradeoff", in Proceedings 2015 IEEE Information Theory Workshop, Jerusalem, Israel, Apr. 2015, pp. 15.
 V. Kostina and S. Verdú, "The output distribution of good lossy source codes", in Proceedings 2015 Information Theory and Applications Workshop, La Jolla, CA, Feb. 2015, pp. 308312.
 V. Kostina, Y. Polyanskiy, and S. Verdú, "Variablelength compression allowing errors", in Proceedings 2014 IEEE International Symposium on Information Theory, Honolulu, HI, July 2014, pp. 26792683.
 V. Kostina and S. Verdú, "Nonasymptotic noisy lossy source coding", in Proceedings 2013 IEEE Information Theory Workshop, Seville, Spain, Sep. 2013, pp. 15.
 V. Kostina and S. Verdú, "Channels with cost constraints: strong converse and dispersion", in Proceedings 2013 IEEE International Symposium on Information Theory, Istanbul, Turkey, July 2013, pp. 17341738.
 S. Loyka, V. Kostina, and F. Gagnon, "Convexity of error rates in digital communications under nonGaussian noise", in Proceedings 2013 IEEE International Symposium on Information Theory, Istanbul, Turkey, July 2013, pp. 4145.
 V. Kostina and S. Verdú, "To code or not to code: Revisited", Proceedings 2012 IEEE Information Theory Workshop, Lausanne, Switzerland, Sep. 2012, pp. 59.
 V. Kostina and S. Verdú, "Lossy joint sourcechannel coding in the finite blocklength regime", in Proceedings 2012 IEEE International Symposium on Information Theory, Cambridge, MA, July 2012, pp. 15531557.
 V. Kostina and S. Verdú, "A new converse in ratedistortion theory", Proceedings 46th Annual Conference on Information Sciences and Systems, Princeton, NJ, Mar. 2012, pp. 16.
 V. Kostina and S. Loyka, "Performance analysis of coded VBLAST with optimum power and rate allocation", in Proceedings 2011 IEEE International Symposium on Information Theory, Saint Petersburg, Russia, Aug. 2011, pp. 18511855.
 V. Kostina and S. Verdú, "Fixedlength lossy compression in the finite blocklength regime: discrete memoryless sources", in Proceedings 2011 IEEE International Symposium on Information Theory, Saint Petersburg, Russia, Aug. 2011, pp. 4145.
 V. Kostina, M. F. Duarte, S. Jafarpour, and R. Calderbank, "The value of redundant measurement in compressed sensing", in Proceedings 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, May 2011, pp. 36563659.
 V. Kostina and S. Verdú, "Fixedlength lossy compression in the finite blocklength regime: Gaussian source", in Proceedings 2011 IEEE Information Theory Workshop, Paraty, Brazil, Oct. 2011, pp. 457461.
 S. Loyka, F. Gagnon, and V. Kostina, "Error rates of capacityachieving codes are convex", in Proceedings 2010 IEEE International Symposium on Information Theory, Austin, TX, June 2010, pp. 325329.
 A. Lorbert, D. Eis, V. Kostina, D. M. Blei, and P. J. Ramadge, "Exploiting covariate similarity in sparse regression via the pairwise elastic net", in Proceedings 13th International Conference on Artificial Intelligence and Statistics, vol. 9, Chia Laguna, Sardinia, Italy, May 2010, pp. 477484.
 S. Loyka, V. Kostina, and F. Gagnon, "Bit error rate is convex at high SNR", in Proceedings 2009 IEEE International Zurich Seminar on Communications, ETH Zurich, Switzerland, Mar. 2010, pp. 4144.
 V. Kostina and S. Loyka, "Optimum power allocation for coded VBLAST", in Proceedings 2009 IEEE International Conference on Communications, Dresden, Germany, June 2009, pp. 16.
 V. Kostina and S. Loyka, "Performance analysis of VBLAST with optimum power allocation", in Proceedings 2007 IEEE Global Telecommunications Conference, Washington, DC, Nov. 2007, pp. 15081513.
 S. Loyka, V. Kostina, and F. Gagnon, "Symbol error rates of maximumlikelihood detector: convex/concave behavior and applications", in Proceedings 2007 IEEE International Symposium on Information Theory, Nice, France, June 2007, pp. 25012505.
 V. Kostina and S. Loyka, "Transmit power allocation for the VBLAST algorithm", in Proceedings 23rd Queen's Biennial Symposium on Communications, Kingston, Canada, May 2006, pp. 165168.
 V. Kostina and S. Loyka, "On optimization of the VBLAST algorithm", in Proceedings 2006 IEEE International Zurich Seminar on Communications, ETH Zurich, Switzerland, Feb. 2006, pp. 110113.
Patents
 M. Effros, V. Kostina, R. C. Yavas, Systems and methods for random access communication, US Patent No. 10,951,292, Mar. 16, 2021.
Matlab Toolbox
 SPECTRE: Short Packet Communication Toolbox provides numerical routines to compute bounds and approximations for some popular channel and source models in finite blocklength information theory.
Teaching
 EE/CS/IDS 160: Fundamentals of Information Transmission and Storage Winter 2020, Winter 2021
Basics of information theory : entropy, mutual information, source and channel coding theorems. Basics of coding theory: errorcorrecting codes for information transmission and storage, block codes, algebraic codes, sparse graph codes. Basics of digital communications: sampling, quantization, digital modulation, matched filters, equalization.  EE/CS/IDS 167: Introduction to Data Compression and Storage Spring 2017, Spring 2019
Prerequisites: Ma 3 or ACM/EE/IDS 116. The course will introduce the students to the basic principles and techniques of codes for data compression and storage. The students will master the basic algorithms used for lossless and lossy compression of digital and analog data and the major ideas behind coding for flash memories. Topics include the Huffman code, the arithmetic code, LempelZiv dictionary techniques, scalar and vector quantizers, transform coding; codes for constrained storage systems.  EE/Ma/CS/IDS 127: ErrorCorrecting Codes Winter 2016, Winter 2017, Fall 2017, Winter 2019
This course develops from first principles the theory and practical implementation of the most important techniques for combating errors in digital transmission or storage systems. Topics include algebraic block codes, e.g., Hamming, BCH, ReedSolomon (including a selfcontained introduction to the theory of finite fields); and the modern theory of sparse graph codes with iterative decoding, e.g., LDPC codes, turbo codes. The students will become acquainted with encoding and decoding algorithms, design principles, and performance evaluation of codes. 
EE/Ma/CS/IDS 136: Topics in Information Theory Spring 2016, Spring 2018
Prerequisites: Ma 3 or ACM/EE/IDS 116. This class introduces information measures such as entropy, information divergence, mutual information, information density from a probabilistic point of view, and discusses the relations of those quantities to problems in data compression and transmission, statistical inference, language modeling, game theory, and control. Topics include information projection, data processing inequalities, sufficient statistics, hypothesis testing, singleshot approach in information theory, large deviations. 
EE 150: Nonasymptotic Information Theory Fall 2014
Prerequisites: EE/Ma 126. Delayconstrained theory of information: singleshot results, information spectrum methods. Informationtheoretic limits for sources and channels with memory and/or general alphabets. Advantages of variablelength, feedback, and joint sourcechannel coding in the nonasymptotic regime. Error exponents, source, and channel dispersion.
Videos
 V. Kostina, "Fundamental limits of distributed tracking", slides, ISIT, June 2020.
 V. Kostina, "An informationtheoretic solution to random access communication", Stanford Information Theory Forum, Nov. 22, 2019.
 V. Kostina, "Towards a theory of information for dynamical systems", Shannon Channel, June 7, 2019.
 V. Kostina, "Exact Minimum Number of Bits to Stabilize a Linear System", Simons Institute, Berkeley, May 1, 2018.
 V. Kostina, "InformationPerformance Tradeoffs in Control", Microsoft Research, Redmond, Apr. 13, 2017.
 V. Kostina, "Fixed and VariableLength Data Compression at Finite Blocklength", IMA, Minneapolis, Apr. 13, 2015.
 V. Kostina, "Lossy Data Compression: Nonasymptotic Fundamental Limits", Mar. 3, 2014.
In the News
 Computational Thinking: How Computer Science Is Revolutionizing Science and Engineering, ENGenious no. 15, Fall 201819.
 Two Caltech Faculty Selected for NSF CAREER Awards, Mar. 5, 2018.
 Professor Kostina Receives NSF CAREER Award, Feb. 12, 2018.
 What Is Possible in RealWorld Communication Systems: An Interview with Victoria Kostina. Feb. 12, 2018.
Contact
Email:  vkostina@caltech.edu 
Office:  Moore 162A 
Mailing address: 
1200 E California Blvd MC 13693 Pasadena CA 91125 
Phone number:  (626) 3951320 
Admin Assistant:  Liliana Chavarria Moore 162B (626) 3954715 email: lchavarr@caltech.edu 
Last updated Oct. 25, 2021.