Manipulability of Future-Independent Tests

Alvaro Sandroni () and Wojciech Olszewski
Additional contact information
Alvaro Sandroni: Department of Economics, University of Pennsylvania

PIER Working Paper Archive from Penn Institute for Economic Research, Department of Economics, University of Pennsylvania

Abstract: The difficulties in properly anticipating key economic variables may encourage decision makers to rely on experts’ forecasts. Professional forecasters, however, may not be reliable and so their forecasts must be empirically tested. This may induce experts to forecast strategically in order to pass the test. A test can be ignorantly passed if a false expert, with no knowledge of the data generating process, can pass the test. Many tests that are unlikely to reject correct forecasts can be ignorantly passed. Tests that cannot be ignorantly passed do exist, but these tests must make use of predictions contingent on data not yet observed at the time the forecasts are rejected. Such tests cannot be run if forecasters report only the probability of the next period’s events on the basis of the actually observed data. This result shows that it is difficult to dismiss false, but strategic, experts who know how theories are tested. This result also shows an important role that can be played by predictions contingent on data not yet observed.

Keywords: Testing; Strategic; Experts (search for similar items in EconPapers)
JEL-codes: C11 D81 (search for similar items in EconPapers)
Pages: 36 pages
Date: 2008-04-15
New Economics Papers: this item is included in nep-for
References: Add references at CitEc
Citations: View citations in EconPapers (17)

Downloads: (external link)
https://economics.sas.upenn.edu/sites/default/file ... ng-papers/08-014.pdf (application/pdf)

Related works:
Journal Article: Manipulability of Future-Independent Tests (2008)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pen:papers:08-014

Access Statistics for this paper

More papers in PIER Working Paper Archive from Penn Institute for Economic Research, Department of Economics, University of Pennsylvania 133 South 36th Street, Philadelphia, PA 19104. Contact information at EDIRC.
Bibliographic data for series maintained by Administrator ().