Article

Free access

The significance of the Cranfield tests on index languages

Author:

SIGIR '91: Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval

Pages 3 - 12

https://doi.org/10.1145/122860.122861

Published: 01 September 1991 Publication History

PDF eReader

References

[1]

CLEVERDON, C.W. and THORNE, R.G. 'An Experiment with the Uniters System ' RAg Library Memo 7, 1954

Google Scholar

[2]

'The Truth, The Whole Truth . . .' American Documentation. 6, p.58

Google Scholar

[3]

CLEVERDON, C.W. Comparative Efficiency of indexing Systems' 2 vols Cranfield. 1960- 62

Google Scholar

[4]

SWANSON, D.R. 'Evidence Underlying the Cranfield Results' Library Quarterly, 35, pp } - 20

Google Scholar

[5]

AITCHISON, j. and CLEVERDON, C.W. Test of the Index of Metallurgical Literature' cranfield, 1963

Google Scholar

[6]

CLEVERDON, C.W. et a} Factors Determining Performance of index Systems'. 2 vols. Cranfield, 1968

Google Scholar

[7]

LESK~ M. and SALTON, G. 'Relevance Assessments and Retrieval System Evaluation' I.R.S. Cornell. 1968

Google Scholar

[8]

CLEVERDON, C.W. 'Effects of Variations in Relevance Assessments ' Cranfield Library Report 3, 1968

Google Scholar

[9]

SPARCK-JONES, K. and BATES, R.G. Research in Automatic Indexing' Computer Lab., Cambridge, 1977

Google Scholar

[10]

SALTON, G. The SMART Retrieval System ~ Experiments in Automatic Document Processing' Prentice-Hall, 1971.

Digital Library

Google Scholar

[11]

LANTZ, B.E. The Relationship Between Documents and Relevant References' Jnl. Documentation 37, pp.134,145

Google Scholar

[12]

Private Communication

Google Scholar

[13]

BORKO, H. Inter-Indexer Consistency' Cranfield Conf. 1979

Google Scholar

[14]

CLEVERDON, C.W. 'Comparative Evaluation of Searching by Controlled and Natural Language in a NASA Database' European Space Agency Report 1/432. 1977

Google Scholar

[15]

SUMMIT, R.K. In Search of the Elusive End-User' Online Review. 13, pp. 185- 91

Google Scholar

[16]

NITCHELL, N. et al. 'End-User Searching in a Medical School Library Med.Ref. Services Quart. _7, pp. 1-33

Google Scholar

Cited By

View all

Fröbe MScells HElstner TAkiki CGienapp LReimer JMacAvaney SStein BHagen MPotthast MHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Resources for Combining Teaching and Research in Information Retrieval CourseworkProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657886(1115-1125)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657886
Breuer TVoorhees ESoboroff IHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Browsing and Searching Metadata of TRECProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657873(313-323)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657873
Schlatt FFröbe MHagen M(2024)Investigating the Effects of Sparse Attention on Cross-EncodersAdvances in Information Retrieval10.1007/978-3-031-56027-9_11(173-190)Online publication date: 20-Mar-2024
https://doi.org/10.1007/978-3-031-56027-9_11
Show More Cited By

Index Terms

The significance of the Cranfield tests on index languages
1. Information systems
  1. Information retrieval
2. Social and professional topics
  1. Professional topics
    1. History of computing

Recommendations

A comparison of statistical significance tests for information retrieval evaluation
CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management

Information retrieval (IR) researchers commonly use three tests of statistical significance: the Student's paired t-test, the Wilcoxon signed rank test, and the sign test. Other researchers have previously proposed using both the bootstrap and Fisher's ...
Testing the significance of index parameters in varying-coefficient single-index models

The varying-coefficient single-index models (VCSIMs) form a class of very flexible and general dimension reduction models, which contain many important regression models such as partially linear models, pure single-index models, partially linear single-...
Significance tests of automatic machine translation evaluation metrics

Automatic evaluation metrics for Machine Translation (MT) systems, such as BLEU, METEOR and the related NIST metric, are becoming increasingly important in MT research and development. This paper presents a significance test-driven comparison of n-gram-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SIGIR '91: Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval

September 1991

359 pages

ISBN:0897914481

DOI:10.1145/122860

Chairman:
Edward Fox
VPI & State Univ., Blackburg, VA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 1991

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SIGIR 91

Sponsor:

German Comp Soc
AICA
SIGIR
BCS-IRSG
INRIA

SIGIR 91: 14th International ACM/SIGIR Conference on Research & Development in Information Retrieval

October 13 - 16, 1991

Illinois, Chicago, USA

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

103
Total Citations
View Citations
2,076
Total Downloads

Downloads (Last 12 months)158
Downloads (Last 6 weeks)31

Reflects downloads up to 16 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Fröbe MScells HElstner TAkiki CGienapp LReimer JMacAvaney SStein BHagen MPotthast MHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Resources for Combining Teaching and Research in Information Retrieval CourseworkProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657886(1115-1125)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657886
Breuer TVoorhees ESoboroff IHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Browsing and Searching Metadata of TRECProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657873(313-323)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657873
Schlatt FFröbe MHagen M(2024)Investigating the Effects of Sparse Attention on Cross-EncodersAdvances in Information Retrieval10.1007/978-3-031-56027-9_11(173-190)Online publication date: 20-Mar-2024
https://doi.org/10.1007/978-3-031-56027-9_11
Giner F(2024)An Intrinsic Framework of Information Retrieval Evaluation MeasuresIntelligent Systems and Applications10.1007/978-3-031-47721-8_47(692-713)Online publication date: 10-Jan-2024
https://doi.org/10.1007/978-3-031-47721-8_47
Rajagopal PAghris TFettah FRavana S(2023)Clustering of Relevant Documents Based on Findability Effort in Information RetrievalInternational Journal of Information Retrieval Research10.4018/IJIRR.31576412:1(1-18)Online publication date: 6-Jan-2023
https://doi.org/10.4018/IJIRR.315764
Giner F(2023)Information Retrieval Evaluation Measures Defined on Some Axiomatic Models of PreferencesACM Transactions on Information Systems10.1145/363217142:3(1-35)Online publication date: 8-Nov-2023
https://dl.acm.org/doi/10.1145/3632171
Siro CAliannejadi MDe Rijke M(2023)Understanding and Predicting User Satisfaction with Conversational Recommender SystemsACM Transactions on Information Systems10.1145/362498942:2(1-37)Online publication date: 8-Nov-2023
https://dl.acm.org/doi/10.1145/3624989
Breuer TFuhr NSchaer P(2023)Validating Synthetic Usage Data in Living Lab EnvironmentsJournal of Data and Information Quality10.1145/3623640Online publication date: 24-Sep-2023
https://dl.acm.org/doi/10.1145/3623640
Gorantla SMehrotra ADeshpande ALouis A(2023)Sampling Individually-Fair Rankings that are Always Group FairProceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society10.1145/3600211.3604671(205-216)Online publication date: 8-Aug-2023
https://dl.acm.org/doi/10.1145/3600211.3604671
Deckers NFröbe MKiesel JPandolfo GSchröder CStein BPotthast M(2023)The Infinite Index: Information Retrieval on Generative Text-To-Image ModelsProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578327(172-186)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578327
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A comparison of statistical significance tests for information retrieval evaluation

Testing the significance of index parameters in varying-coefficient single-index models

Significance tests of automatic machine translation evaluation metrics