Segueix
Ivan Stelmakh
Ivan Stelmakh
Correu electrònic verificat a cs.cmu.edu - Pàgina d'inici
Títol
Citada per
Citada per
Any
PeerReview4All: Fair and accurate reviewer assignment in peer review
I Stelmakh, NB Shah, A Singh
Algorithmic Learning Theory, 828-856, 2019
962019
On testing for biases in peer review
I Stelmakh, N Shah, A Singh
Advances in Neural Information Processing Systems 32, 2019
532019
ASQA: Factoid questions meet long-form answers
I Stelmakh, Y Luan, B Dhingra, MW Chang
arXiv preprint arXiv:2204.06092, 2022
472022
Catch me if i can: Detecting strategic behaviour in peer assessment
I Stelmakh, NB Shah, A Singh
Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4794-4802, 2021
302021
A novice-reviewer experiment to address scarcity of qualified reviewers in large conferences
I Stelmakh, NB Shah, A Singh, H Daumé III
Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4785-4793, 2021
302021
Prior and prejudice: The novice reviewers' bias against resubmissions in conference peer review
I Stelmakh, NB Shah, A Singh, H Daumé III
Proceedings of the ACM on Human-Computer Interaction 5 (CSCW1), 1-17, 2021
302021
Crowdspeech and voxdiy: Benchmark datasets for crowdsourced audio transcription
N Pavlichenko, I Stelmakh, D Ustalov
arXiv preprint arXiv:2107.01091, 2021
262021
A large scale randomized controlled trial on herding in peer-review discussions
I Stelmakh, C Rastogi, NB Shah, A Singh, H Daumé III
Plos one 18 (7), e0287443, 2023
212023
Debiasing evaluations that are biased by evaluations
J Wang, I Stelmakh, Y Wei, NB Shah
Proceedings of the AAAI Conference on Artificial Intelligence 35 (11), 10120 …, 2021
192021
A gold standard dataset for the reviewer assignment problem
I Stelmakh, J Wieting, G Neubig, NB Shah
arXiv preprint arXiv:2303.16750, 2023
92023
Cite-seeing and reviewing: A study on citation bias in peer review
I Stelmakh, C Rastogi, R Liu, S Chawla, F Echenique, NB Shah
Plos one 18 (7), e0283980, 2023
82023
How do Authors' Perceptions of their Papers Compare with Co-authors' Perceptions and Peer-review Decisions?
C Rastogi, I Stelmakh, A Beygelzimer, YN Dauphin, P Liang, JW Vaughan, ...
arXiv preprint arXiv:2211.12966, 2022
82022
To ArXiv or not to ArXiv: A study quantifying pros and cons of posting preprints online
C Rastogi, I Stelmakh, X Shen, M Meila, F Echenique, S Chawla, ...
arXiv preprint arXiv:2203.17259, 2022
82022
Towards fair, equitable, and efficient peer review
I Stelmakh
Proceedings of the AAAI Conference on Artificial Intelligence 35 (18), 15736 …, 2021
42021
VLDB 2021 Crowd Science Challenge on Aggregating Crowdsourced Audio Transcriptions.
D Ustalov, N Pavlichenko, I Stelmakh, D Kuznetsov
CSW@ VLDB, 1-7, 2021
32021
No Rose for MLE: Inadmissibility of MLE for Evaluation Aggregation Under Levels of Expertise
C Rastogi, I Stelmakh, N Shah, S Balakrishnan
2022 IEEE International Symposium on Information Theory (ISIT), 3168-3173, 2022
12022
A Randomized Controlled Trial on Anonymizing Reviewers to Each Other in Peer Review Discussions
C Rastogi, X Song, Z Jin, I Stelmakh, H Daumé III, K Zhang, NB Shah
arXiv preprint arXiv:2403.01015, 2024
2024
Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments
A Goldberg, I Stelmakh, K Cho, A Oh, A Agarwal, D Belgrave, NB Shah
arXiv preprint arXiv:2311.09497, 2023
2023
Making Scientific Peer Review Scientific
I Stelmakh
Carnegie Mellon University, 2022
2022
A Study Quantifying Pros and Cons of Posting Preprints Online
C Rastogi, I Stelmakh, X Shen, M Meila, F Echenique, S Chawla, ...
arXiv preprint arXiv:2203.17259, 2022
2022
En aquests moments el sistema no pot dur a terme l'operació. Torneu-ho a provar més tard.
Articles 1–20