Notes for the interviewer:
This problem can go in many directions. Allow 5 minutes to brainstorm ideas but then focus the person on taking actions. The goal is for them to run many queries to find out what is happening. There should be direct connection to business metrics. They should briefly list issues but not get mired in implementation details.
Positive Examples:
- (Easier to solve) Are customers inappropriately sharing login information?
- Frame it as Unsupervised - Clustering or anomaly detection
- Solution - Turn on 2 factor authentication or other features.
- (Harder to solve) Are the customers reposting videos on other websites?
- Find the videos through web scraping or hiring a service.
- Identify which customers are re-posting. Could be tricky, maybe through watch logs and creating honeypots.
Negative Examples:
- Since the company has few (and premium) customers, do not do anything that would be a false positive. It would be costly to the organization to lose a customer by false acquisition.
Rubric to score interviewee. Mark your feedback, then hand to the interviewee at the end.
Score each line from 1 to 5: 1 = Very bad, 2 = Bad, 3 = Neutral, 4 = Good, 5 = Very Good
Delivery
- Professional appearance: 1 2 3 4 5
- Overall conduct: 1 2 3 4 5
- Tone: 1 2 3 4 5
- Volume: 1 2 3 4 5
- Speed: 1 2 3 4 5
- 2-way conversation: 1 2 3 4 5
- Body / hand movements: 1 2 3 4 5
- Eye contact: 1 2 3 4 5
- Other:
Technical Merits
- Understood the business: 1 2 3 4 5
- Listed many types of fraud: 1 2 3 4 5
- Brainstorm data / evidence: 1 2 3 4 5
- Discussed empirical solutions: 1 2 3 4 5
- Listed common problems / pitfalls: 1 2 3 4 5
- Create solutions for all stakeholders: 1 2 3 4 5
- Other:
The single thing the person could better: