CVS Health: Detect cost anomalies via Z-score and Isolation Forest consensus. Python, Scikit-learn, Scipy, Pandas.
In this exercise, we are providing you with an example of financial data (all numbers are fictional).
You need to create an algorithm that can find outliers in this data by one column / several columns. E.g. some members have extremely high costs in the current month and your solution should be able to detect such records. Think about features and how you would explain them to business people.
The dataset sfr_test.csv contains fictional financial information about customers of the company.
Below is the description of the selected columns from this dataset:
member_unique_id - member's IDgender - member's genderdob - member's date of birtheligible_year - yeareligible_month - monthaffiliation_type - doctor's typepbp_group - health plan groupplan_name - health plan namenpi - doctor's IDline_of_business - health plan typeesrd - True if patient is on dialysishospice - True if patient is in hospiceThe remaining columns contain various financial indicators. All values in these financial columns contain a $ sign.
Please provide a Jupyter notebook describing your approach as a result of this task.
Since it is an open-ended task, your solution will need to include your thought process, including data exploration, outlier detection approaches, results, and interpretation. Your code must be well-structured, and all outputs (numerical and visual) are properly documented and easily readable. Always keep in mind that the final document would be read by someone with a business background, so be sure to clearly explain any technical terms and metrics. You should spend no more than 2-3 hours on this task.