More Web Proxy on the site http://driver.im/

research-article

GridBook: Natural Language Formulas for the Spreadsheet Grid

Authors:

Sruti Srinivasa Ragavan,

Andrew D Gordon,

Dongmei ZhangAuthors Info & Claims

IUI '22: Proceedings of the 27th International Conference on Intelligent User Interfaces

Pages 345 - 368

https://doi.org/10.1145/3490099.3511161

Published: 22 March 2022 Publication History

Abstract

Writing formulas on the spreadsheet grid is arguably the most widely practiced form of programming. Still, studies highlight the difficulties experienced by end-user programmers when learning and using traditional formulas, especially for slightly complex tasks. The purpose of GridBook is to ease these difficulties by supporting formulas expressed in natural language within the grid; it is the first system to do so.

GridBook builds on a parser utilizing deep learning to understand analysis intents from the natural language input within a spreadsheet cell. GridBook also leverages the spatial context between cells to infer the analysis parameters underspecified in the natural language input. Natural language enables users to analyze data easily and flexibly, to build queries on the results of previous analyses, and to view results intelligibly within the grid—thus taking spreadsheets one step closer to computational notebooks.

We evaluated GridBook via two comparative lab studies, with 20 data analysts new only to GridBook. In our studies, there were no significant differences, in terms of time and cognitive load, in participants’ data analysis using GridBook and spreadsheets; however, data analysis with GridBook was significantly faster than with computational notebooks. Our study uncovers insights into the application of natural language as a special purpose programming language for end-user programming in spreadsheets.

Supplementary Material

MP4 File (iui22-59-video-540p.mp4)

Supplemental video

Download
3.57 MB

References

[1]

Abraham, Robin, and Martin Erwig. "UCheck: A spreadsheet type checker for end users." Journal of Visual Languages & Computing 18, no. 1 (2007): 71-95.

Digital Library

[2]

Amar, Robert, James Eagan, and John Stasko. "Low-level components of analytic activity in information visualization." In IEEE Symposium on Information Visualization, 2005. INFOVIS 2005., pp. 111-117. IEEE, 2005.

[3]

Amouzgar, Farhad, Amin Beheshti, Samira Ghodratnama, Boualem Benatallah, Jian Yang, and Quan Z. Sheng. "iSheets: a spreadsheet-based machine learning development platform for data-driven process analytics." In International Conference on Service-Oriented Computing, pp. 453-457. Springer, Cham, 2018.

[4]

Ballard, Bruce W., and Alan W. Biermann. "Programming in natural language: “NLC” as a prototype." In Proceedings of the 1979 annual conference, pp. 228-237. 1979.

[5]

Barricelli, Barbara Rita, Fabio Cassano, Daniela Fogli, and Antonio Piccinno. "End-user development, end-user programming and end-user software engineering: A systematic mapping study." Journal of Systems and Software 149 (2019): 101-137.

[6]

Borowski, Marcel, Johannes Zagermann, Clemens N. Klokmose, Harald Reiterer, and Roman Rädle. "Exploring the Benefits and Barriers of Using Computational Notebooks for Collaborative Programming Assignments." In Proceedings of the 51st ACM Technical Symposium on Computer Science Education, pp. 468-474. 2020.

[7]

Bruckman, Amy, and Elizabeth Edwards. "Should we leverage natural-language knowledge? An analysis of user errors in a natural-language-style programming language." In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pp. 207-214. 1999.

[8]

Burnett, Margaret. "What is end-user software engineering and why does it matter?" In International symposium on end user development, pp. 15-28. Springer, Berlin, Heidelberg, 2009.

[9]

Carroll, John M., and Mary Beth Rosson. "Paradox of the active user." In Interfacing thought: Cognitive aspects of human-computer interaction, pp. 80-111. 1987.

Digital Library

[10]

Chambers, Chris, and Chris Scaffidi. "Struggling to excel: A field study of challenges faced by spreadsheet users." In 2010 IEEE Symposium on Visual Languages and Human-Centric Computing, pp. 187-194. IEEE, 2010.

[11]

Chattopadhyay, Souti, Ishita Prasad, Austin Z. Henley, Anita Sarma, and Titus Barik. "What's Wrong with Computational Notebooks? Pain Points, Needs, and Design Opportunities." In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1-12. 2020.

[12]

Chen, Xinyun, Petros Maniatis, Rishabh Singh, Charles Sutton, Hanjun Dai, Max Lin, and Denny Zhou. "SpreadsheetCoder: Formula Prediction from Semi-structured Context." In International Conference on Machine Learning, pp. 1661-1672. PMLR, 2021.

[13]

Dhamdhere, Kedar, Kevin S. McCurley, Ralfi Nahmias, Mukund Sundararajan, and Qiqi Yan. "Analyza: Exploring data with conversation." In Proceedings of the 22nd International Conference on Intelligent User Interfaces, pp. 493-504. 2017.

[14]

Dogga, Pradeep, Karthik Narasimhan, Anirudh Sivaraman, and Ravi Netravali. "A system-wide debugging assistant powered by natural language processing." In Proceedings of the ACM Symposium on Cloud Computing, pp. 171-177. 2019.

[15]

Dong, Haoyu, Shijie Liu, Shi Han, Zhouyu Fu, and Dongmei Zhang. "Tablesense: Spreadsheet table detection with convolutional neural networks." In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 69-76. 2019.

Digital Library

[16]

Elgohary, Ahmed, Saghar Hosseini, and Ahmed Hassan Awadallah. "Speak to your parser: Interactive text-to-SQL with natural language feedback." arXiv preprint arXiv:2005.02539 (2020).

[17]

Ernst, Michael D. "Natural language is a programming language: Applying natural language processing to software development." In 2nd Summit on Advances in Programming Languages (SNAPL 2017). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 2017.

[18]

Furnas, George W., Thomas K. Landauer, Louis M. Gomez, and Susan T. Dumais. "The vocabulary problem in human-system communication." Communications of the ACM 30, no. 11 (1987): 964-971.

[19]

Gao, Tong, Mira Dontcheva, Eytan Adar, Zhicheng Liu, and Karrie G. Karahalios. "Datatone: Managing ambiguity in natural language interfaces for data visualization." In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pp. 489-500. 2015.

[20]

Gordon, Andy, and Simon Peyton Jones. (January, 2021) "LAMBDA: The ultimate Excel worksheet function." Available at: https://www.microsoft.com/en-us/research/blog/lambda-the-ultimatae-excel-worksheet-function/

[21]

Grigoreanu, Valentina, Margaret Burnett, Susan Wiedenbeck, Jill Cao, Kyle Rector, and Irwin Kwan. "End-user debugging strategies: A sensemaking perspective." ACM Transactions on Computer-Human Interaction (TOCHI) 19, no. 1 (2012): 1-28.

Digital Library

[22]

Gulwani, Sumit, and Mark Marron. "Nlyze: Interactive programming by natural language for spreadsheet data analysis and manipulation." In Proceedings of the 2014 ACM SIGMOD international conference on Management of data, pp. 803-814. 2014.

[23]

Hart, Sandra G., and Lowell E. Staveland. "Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research." In Advances in psychology, vol. 52, pp. 139-183. North-Holland, 1988.

[24]

Head, Andrew, Fred Hohman, Titus Barik, Steven M. Drucker, and Robert DeLine. "Managing messes in computational notebooks." In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1-12. 2019.

[25]

Hendry, David G., and Thomas RG Green. "Creating, comprehending and explaining spreadsheets: a cognitive interpretation of what discretionary users think of the spreadsheet model." International Journal of Human-Computer Studies 40, no. 6 (1994): 1033-1065.

Digital Library

[26]

Hermans, F., Pinzger, M., & van Deursen, A. (2015). Detecting and refactoring code smells in spreadsheet formulas. Empirical Software Engineering, 20(2), 549-575.

[27]

Hermans, Felienne, Bas Jansen, Sohon Roy, Efthimia Aivaloglou, Alaaeddin Swidan, and David Hoepelman. "Spreadsheets are code: An overview of software engineering approaches applied to spreadsheets." In 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER), vol. 5, pp. 56-65. IEEE, 2016.

[28]

Hodnigg, Karin, and Roland T. Mittermeir. "Metrics-based spreadsheet visualization: Support for focused maintenance." arXiv preprint arXiv:0809.3009 (2008).

[29]

Hoque, Enamul, Vidya Setlur, Melanie Tory, and Isaac Dykeman. "Applying pragmatics principles for interaction with visual analytics." IEEE transactions on visualization and computer graphics 24, no. 1 (2017): 309-318.

[30]

Huang, Junyang, Yongbo Wang, Yongliang Wang, Yang Dong, and Yanghua Xiao. "Relation Aware Semi-autoregressive Semantic Parsing for NL2SQL." arXiv preprint arXiv:2108.00804 (2021).

[31]

Huang, Po-Sen, Chenglong Wang, Rishabh Singh, Wen-tau Yih, and Xiaodong He. "Natural language to structured query generation via meta-learning." arXiv preprint arXiv:1803.02400 (2018).

[32]

India crimes data. https://www.kaggle.com/webaccess/india-crimes-data. Retrieved 1st October, 2020.

[33]

Iyer, Srinivasan, Ioannis Konstas, Alvin Cheung, Jayant Krishnamurthy, and Luke Zettlemoyer. "Learning a neural semantic parser from user feedback." arXiv preprint arXiv:1704.08760 (2017).

[34]

Jean E. Sammet. 1966. The use of English as a programming language. Commun. ACM 9, 3 (March 1966), 228–230.

Digital Library

[35]

Jia, Yunyi, Lanbo She, Yu Cheng, Jiatong Bao, Joyce Y. Chai, and Ning Xi. "Program robots manufacturing tasks by natural language instructions." In 2016 IEEE International Conference on Automation Science and Engineering (CASE), pp. 633-638. IEEE, 2016.

[36]

Joharizadeh, Nima, Advait Sarkar, Andrew D. Gordon, and Jack Williams. "Gridlets: Reusing spreadsheet grids." In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1-7. 2020.

[37]

Kery, Mary Beth, Donghao Ren, Fred Hohman, Dominik Moritz, Kanit Wongsuphasawat, and Kayur Patel. "mage: Fluid Moves Between Code and Graphical Work in Computational Notebooks." In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, pp. 140-151. 2020.

[38]

Knuth, Donald Ervin. "Literate programming." The computer journal 27, no. 2 (1984): 97-111.

Digital Library

[39]

Ko, Amy J., and Brad A. Myers. "Designing the whyline: a debugging interface for asking questions about program behavior." In Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 151-158. 2004.

[40]

Ko, Amy J., Robin Abraham, Laura Beckwith, Alan Blackwell, Margaret Burnett, Martin Erwig, Chris Scaffidi "The state of the art in end-user software engineering." ACM Computing Surveys (CSUR) 43, no. 3 (2011): 1-44.

Digital Library

[41]

Koci, Elvis, Dana Kuban, Nico Luettig, Dominik Olwig, Maik Thiele, Julius Gonsior, Wolfgang Lehner, and Oscar Romero. "Xlindy: Interactive recognition and information extraction in spreadsheets." In Proceedings of the ACM Symposium on Document Engineering 2019, pp. 1-4. 2019.

[42]

Koci, Elvis, Maik Thiele, Óscar Romero Moral, and Wolfgang Lehner. "A machine learning approach for layout inference in spreadsheets." In IC3K 2016: Proceedings of the 8th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management: volume 1: KDIR, pp. 77-88. SciTePress, 2016.

[43]

Kohlhase, A., Kohlhase, M., & Guseva, A. (2015). Context in Spreadsheet Comprehension. In SEMS@ ICSE (pp. 21-27).

[44]

Lau, Sam, Ian Drosos, Julia M. Markel, and Philip J. Guo. "The Design Space of Computational Notebooks: An Analysis of 60 Systems in Academia and Industry." In 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 1-11. IEEE, 2020.

[45]

Lau, Sam, Sruti Srinivasa Ragavan, Ken Milne, Titus Barik, and Advait Sarkar. "TweakIt: Supporting End-User Programmers Who Transmogrify Code." In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1-12. 2021.

[46]

Lauria, Stanislao, Guido Bugmann, Theocharis Kyriacou, Johan Bos, and A. Klein. "Training personal robots using natural language instruction." IEEE Intelligent systems 16, no. 5 (2001): 38-45.

[47]

Le, Vu, Sumit Gulwani, and Zhendong Su. "Smartsynth: Synthesizing smartphone automation scripts from natural language." In Proceeding of the 11th annual international conference on Mobile systems, applications, and services, pp. 193-206. 2013.

[48]

Li, Yuntao, Bei Chen, Qian Liu, Yan Gao, Jian-Guang Lou, Yan Zhang, and Dongmei Zhang. "" What Do You Mean by That?" A Parser-Independent Interactive Approach for Enhancing Text-to-SQL." arXiv preprint arXiv:2011.04151 (2020).

[49]

Lieberman, Henry, and Hugo Liu. "Feasibility studies for programming in natural language." In End User Development, pp. 459-473. Springer, Dordrecht, 2006.

[50]

Lieberman, Henry, Fabio Paternò, and Volker Wulf. (eds). "End-user development”. Kluwer/ Springer. 2006.

[51]

Miller, Lance A. "Natural language programming: Styles, strategies, and contrasts." IBM Systems Journal 20, no. 2 (1981): 184-215.

Digital Library

[52]

Nan, Zifan, Hui Guan, and Xipeng Shen. "HISyn: human learning-inspired natural language programming." In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, pp. 75-86. 2020.

[53]

Nardi, Bonnie A. A small matter of programming: perspectives on end user computing. MIT press, 1993.

[54]

Narechania, Arpit, Arjun Srinivasan, and John Stasko. "NL4DV: A toolkit for generating analytic specifications for data visualization from natural language queries." IEEE Transactions on Visualization and Computer Graphics 27, no. 2 (2020): 369-379.

[55]

Norman, Don. The design of everyday things: Revised and expanded edition. Basic books, 2013.

[56]

OpenAI Codex. https://openai.com/blog/openai-codex/. Retrieved 8th October, 2021.

[57]

Pane, John F., and Brad A. Myers. "More natural programming languages and environments." In End user development, pp. 31-50. Springer, Dordrecht, 2006.

[58]

Pane, John F., and Brad A. Myers. "Studying the language and structure in non-programmers' solutions to programming problems." International Journal of Human-Computer Studies 54, no. 2 (2001): 237-264.

Digital Library

[59]

Panko, Raymond R. "Spreadsheet errors: What we know. what we think we can do." arXiv preprint arXiv:0802.3457 (2008).

[60]

Panko, Raymond R. "Two experiments in reducing overconfidence in spreadsheet development." Journal of Organizational and End User Computing (JOEUC) 19, no. 1 (2007): 1-23.

[61]

Powell, Stephen G., Kenneth R. Baker, and Barry Lawson. "A critical review of the literature on spreadsheet errors." Decision Support Systems 46, no. 1 (2008): 128-138.

Digital Library

[62]

Price, David, Ellen Rilofff, Joseph Zachary, and Brandon Harvey. "NaturalJava: A natural language interface for programming in Java." In Proceedings of the 5th international conference on Intelligent user interfaces, pp. 207-211. 2000.

[63]

Ramshaw, Lance A., and Mitchell P. Marcus. "Text chunking using transformation-based learning." In Natural language processing using very large corpora, pp. 157-176. Springer, Dordrecht, 1999.

[64]

Raza, Mohammad, Sumit Gulwani, and Natasa Milic-Frayling. "Compositional program synthesis from natural language and examples." In Twenty-Fourth International Joint Conference on Artificial Intelligence. 2015.

[65]

Rothermel, K. J., Cook, C. R., Burnett, M. M., Schonfeld, J., Green, T. R., & Rothermel, G. (2000, June). WYSIWYT testing in the spreadsheet paradigm: An empirical evaluation. In Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium (pp. 230-239). IEEE.

[66]

Rule, Adam, Aurélien Tabard, and James D. Hollan. "Exploration and explanation in computational notebooks." In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1-12. 2018.

[67]

Rule, Adam, Ian Drosos, Aurélien Tabard, and James D. Hollan. "Aiding collaborative reuse of computational notebooks with annotated cell folding." Proceedings of the ACM on Human-Computer Interaction 2, no. CSCW (2018): 1-12.

[68]

Sarkar, Advait, Andrew D. Gordon, Simon Peyton Jones, and Neil Toronto. "Calculation view: multiple-representation editing in spreadsheets." In 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 85-93. IEEE, 2018.

[69]

Sarkar, Advait, Mateja Jamnik, Alan F. Blackwell, and Martin Spott. "Interactive visual machine learning in spreadsheets." In 2015 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 159-163. IEEE, 2015.

[70]

Scaffidi, Christopher, Mary Shaw, and Brad Myers. "Estimating the numbers of end users and end user programmers." In 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'05), pp. 207-214. IEEE, 2005.

[71]

Scaffidi, Christopher. "The impact of human-centric design on the adoption of information systems: A case study of the spreadsheet." In 2016 11th Iberian Conference on Information Systems and Technologies (CISTI), pp. 1-7. IEEE, 2016.

[72]

Schlegel, Viktor, Benedikt Lang, Siegfried Handschuh, and André Freitas. "Vajra: step-by-step programming with natural language." In Proceedings of the 24th International Conference on Intelligent User Interfaces, pp. 30-39. 2019.

[73]

Setlur, Vidya, Melanie Tory, and Alex Djalali. "Inferencing underspecified natural language utterances in visual analysis." Proceedings of the 24th International Conference on Intelligent User Interfaces. 2019.

[74]

Setlur, Vidya, Sarah E. Battersby, Melanie Tory, Rich Gossweiler, and Angel X. Chang. "Eviza: A natural language interface for visual analysis." In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pp. 365-377. 2016.

[75]

Srinivasa Ragavan, Sruti, Advait Sarkar, and Andrew D. Gordon. "Spreadsheet Comprehension: Guesswork, Giving Up and Going Back to the Author." In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1-21. 2021.

[76]

Srinivasan, Arjun, and John Stasko. "Orko: Facilitating multimodal interaction for visual exploration and analysis of networks." IEEE transactions on visualization and computer graphics 24, no. 1 (2017): 511-521.

[77]

Tang, Lappoon R., and Raymond Mooney. "Automated construction of database interfaces: Intergrating statistical and relational learning for semantic parsing." In 2000 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pp. 133-141. 2000.

[78]

Tellex, Stefanie, Nakul Gopalan, Hadas Kress-Gazit, and Cynthia Matuszek. "Robots that use language." Annual Review of Control, Robotics, and Autonomous Systems 3 (2020): 25-55.

[79]

Tichy, Walter F., Rolf L. Adams, and Lars Holter. "NLH/E: A natural language help system." In Proceedings of the 11th international conference on Software engineering, pp. 364-374. 1989.

[80]

Vaswani, Ashish, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. "Attention is all you need." In Advances in neural information processing systems, pp. 5998-6008. 2017.

[81]

Wachtel, Alexander, Dominik Fuchß, Matthias Przybylla, and Walter F. Tichy. "Natural Language Data Queries on Multiple Heterogenous Data Sources." In International Symposium on End User Development, pp. 174-182. Springer, Cham, 2019.

[82]

Wachtel, Alexander, Michael T. Franzen, and Walter F. Tichy. "Context Detection in Spreadsheets Based on Automatically Inferred Table Schema." International Journal of Computer and Information Engineering 10, no. 10 (2016): 1892-1899.

[83]

Wachtel, Alexander, Sebastian Weigelt, and Walter F. Tichy. "Initial implementation of natural language turn-based dialog system." Procedia Computer Science 84 (2016): 49-56.

[84]

Wang, April Yi, Anant Mittal, Christopher Brooks, and Steve Oney. "How data scientists use computational notebooks for real-time collaboration." Proceedings of the ACM on Human-Computer Interaction 3, no. CSCW (2019): 1-30.

[85]

Wang, April Yi, Dakuo Wang, Jaimie Drozdal, Michael Muller, Soya Park, Justin D. Weisz, Xuye Liu, Lingfei Wu, and Casey Dugan. "Themisto: Towards Automated Documentation Generation in Computational Notebooks." arXiv preprint arXiv:2102.12592 (2021).

[86]

Wang, Chenglong, Kedar Tatwawadi, Marc Brockschmidt, Po-Sen Huang, Yi Mao, Oleksandr Polozov, and Rishabh Singh. "Robust text-to-sql generation with execution-guided decoding." arXiv preprint arXiv:1807.03100 (2018).

[87]

Wang, Chenglong, Marc Brockschmidt, and Rishabh Singh. "Pointing out SQL queries from text." (2018).

[88]

Warren, D. H. D. and Pereira, F. C. N. (1982). An efficient easily adaptable system for interpreting natural language queries. Comput. Linguist., 8(3-4):110–122.

[89]

Weigelt, Sebastian, Vanessa Steurer, Tobias Hey, and Walter F. Tichy. "Programming in natural language with fuse: Synthesizing methods from spoken utterances using deep natural language understanding." In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 4280-4295. 2020.

[90]

Weinman, Nathaniel, Steven M. Drucker, Titus Barik, and Robert DeLine. "Fork It: Supporting Stateful Alternatives in Computational Notebooks." In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1-12. 2021.

[91]

Williams, Jack, Carina Negreanu, Andrew D. Gordon, and Advait Sarkar. "Understanding and Inferring Units in Spreadsheets." In 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 1-9. IEEE, 2020.

[92]

Williams, Jack, Nima Joharizadeh, Andrew D. Gordon, and Advait Sarkar. "Higher-Order Spreadsheets with Spilled Arrays." In ESOP, pp. 743-769. 2020.

[93]

Yu, Bowen, and Cláudio T. Silva. "FlowSense: A natural language interface for visual data exploration within a dataflow system." IEEE transactions on visualization and computer graphics 26, no. 1 (2019): 1-11.

[94]

Yu, Tao, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma "Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task." In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 3911-3921. 2018.

[95]

Zhang, Yakun, Wensheng Dou, Jiaxin Zhu, Liang Xu, Zhiyong Zhou, Jun Wei, Dan Ye, and Bo Yang. "Learning to detect table clones in spreadsheets." In Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis, pp. 528-540. 2020.

[96]

Zhong, Victor, Caiming Xiong, and Richard Socher. "Seq2sql: Generating structured queries from natural language using reinforcement learning." arXiv preprint arXiv:1709.00103 (2017)

[97]

GridBook. Microsoft Research. https://www.microsoft.com/en-us/research/project/gridbook/. Retrieved 10th February, 2022.

Cited By

Gao JGebreegziabher SChoo KLi TPerrault SMalone T(2024)A Taxonomy for Human-LLM Interaction Modes: An Initial ExplorationExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650786(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650786
Tankelevitch LKewenig VSimkute AScott ASarkar ASellen ARintel S(2024)The Metacognitive Demands and Opportunities of Generative AIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642902(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642902
Ge YDai YShan RLi KHu YSun X(2024)Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programming2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL/HCC60511.2024.00020(89-95)Online publication date: 2-Sep-2024
https://doi.org/10.1109/VL/HCC60511.2024.00020
Show More Cited By

Index Terms

GridBook: Natural Language Formulas for the Spreadsheet Grid

Index terms have been assigned to the content through auto-classification.

Recommendations

The restriction language for computer grammars of natural language

Over the past few years, a number of systems for the computer analysis of natural language sentences have been based on augmented context-free grammars: a context-free grammar which defines a set of parse trees for a sentence, plus a group of ...
Is natural language an unnatural query language?
ACM '72: Proceedings of the ACM annual conference - Volume 2

The complex system of form/meaning correlations comprising a natural language presents a considerable challenge for automated interpretation. In order to deal with such complexity, attempts at automated interpretation of natural language queries have ...
Towards a Natural Language Compiler
Advances in Computational Intelligence
Abstract
Being able to create a natural language compiler has been one of the most sought-after goals to reach since the very beginning of artificial intelligence. Since then; however, it has been an elusive and difficult task to achieve to the extent of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '22: Proceedings of the 27th International Conference on Intelligent User Interfaces

March 2022

888 pages

ISBN:9781450391443

DOI:10.1145/3490099

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 March 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

IUI '22

Sponsor:

IUI '22: 27th International Conference on Intelligent User Interfaces

March 22 - 25, 2022

Helsinki, Finland

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
423
Total Downloads

Downloads (Last 12 months)99
Downloads (Last 6 weeks)22

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gao JGebreegziabher SChoo KLi TPerrault SMalone T(2024)A Taxonomy for Human-LLM Interaction Modes: An Initial ExplorationExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650786(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650786
Tankelevitch LKewenig VSimkute AScott ASarkar ASellen ARintel S(2024)The Metacognitive Demands and Opportunities of Generative AIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642902(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642902
Ge YDai YShan RLi KHu YSun X(2024)Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programming2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL/HCC60511.2024.00020(89-95)Online publication date: 2-Sep-2024
https://doi.org/10.1109/VL/HCC60511.2024.00020
Huang YZhou YChen RPan CShu XWeng DWu Y(2024)Interactive Table Synthesis With Natural LanguageIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332912030:9(6130-6145)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3329120
Simkute ATankelevitch LKewenig VScott ASellen ARintel S(2024)Ironies of Generative AI: Understanding and Mitigating Productivity Loss in Human-AI InteractionInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2405782(1-22)Online publication date: 15-Oct-2024
https://doi.org/10.1080/10447318.2024.2405782
Jadoon AYu CShi Y(2024)ContextMate: a context-aware smart agent for efficient data analysisCCF Transactions on Pervasive Computing and Interaction10.1007/s42486-023-00144-76:3(199-227)Online publication date: 16-Apr-2024
https://doi.org/10.1007/s42486-023-00144-7
Liu MSarkar ANegreanu CZorn BWilliams JToronto NGordon A(2023)“What It Wants Me To Say”: Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language ModelsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580817(1-31)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580817
Goel HKumar ARagavan S(2023)End-User Programming is WEIRD: How, Why and What to Do About It2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL-HCC57772.2023.00013(41-50)Online publication date: 3-Oct-2023
https://doi.org/10.1109/VL-HCC57772.2023.00013

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents