RAMS Evaluation Materials
AI models are evaluated on their ability to analyze and review Risk Assessment Method Statements (RAMS). Below is the sample risk assessment document used in testing.
Risk Assessment: Manual Handling of Banana Crates
Northern Data Campus – Modular Mechanical and Lifting Works
Risk Assessment Matrix
Likelihood Rating Key:
- 5 - Frequent (1 or more per week)
- 4 - Probable (1 per month)
- 3 - Occasional (1 per year)
- 2 - Remote (1 in 10 years)
- 1 - Improbable (1 in 100 years)
Severity Rating Key:
- 5 - Multiple/Single Fatality or Structural Collapse
- 4 - Major Injury or Major Property Damage
- 3 - Reportable Lost Time Injury
- 2 - Other Lost Time Injury
- 1 - Minor Injury
Residual Risk Rating Matrix:
- 12-25: Unacceptable - Operations WILL NOT proceed
- 5-11: Acceptable with control measures implemented
- 1-4: Acceptable level of risk
| Hazard | Persons at Risk | L | S | IR | Control Measures | L | S | RR |
|---|---|---|---|---|---|---|---|---|
| Storage and Workplace Conditions | Operators, Public, Other operatives | 3 | 4 | 7 | Stable ground provided, area clearly defined, ground bearing checked, away from excavations | 1 | 8 | 8 |
| Use of Lifting Equipment | Plant operator, Slinger, Other operatives | 3 | 4 | 7 | Only CPCS certificated persons operate, lifting plan in place, exclusion zone maintained | 1 | 8 | 8 |
| Equipment Condition | Plant operator, Slinger, Other operatives | 3 | 5 | 20 | Daily/weekly checks logged, tested yearly, SWL not exceeded, safe slinging practices | 2 | 4 | 4 |
| Slips and Trips | Operators, Other operatives | 4 | 5 | 20 | Ground flat and tidy, suitable footwear worn, good lighting, good housekeeping | 2 | 6 | 6 |
| Crane Base Stability | Plant operator, Slinger, Other operatives | 3 | 4 | 12 | Base designed by engineer, weekly inspections, CBR testing, underground services noted | 1 | 3 | 3 |
| Lifting Operations | All personnel | 4 | 5 | 10 | CPCS trained operators, clear visibility/signals, two-way radios, weather reviewed, lifting schedule followed | 2 | 5 | 4 |
| Operations Near Buildings | All personnel | 4 | 4 | 20 | Slew restrictor engaged, forbidden zones marked, daily briefings, taglines fitted | 2 | 3 | 3 |
| Weather Conditions | All personnel | 3 | 3 | 6 | Daily weather forecast consulted, anemometer checked, wind procedure followed, operations suspended in poor visibility | 2 | 4 | 4 |
| Uncontrolled Load | All personnel | 3 | 3 | 6 | Duty to stop work if unsafe, escape routes identified, taglines used immediately | 2 | 2 | 4 |
| Dropped Load | All personnel | 2 | 3 | 6 | Competent slinging, cargo checked for loose debris, no personnel under load | 2 | 2 | 4 |
| Crane Driver Health | Operator | 2 | 3 | 6 | Medical fitness certificate required | 2 | 2 | 4 |
| Working at Height | Operator, Rigging Team, Slinger | 2 | 3 | 6 | Edge protection in place, appropriate footwear/gloves, fall arrest systems, rescue plan | 2 | 2 | 4 |
| Communication | Crane team | 3 | 6 | 12 | Agreed hand signals, one language, repeated instructions, replacement radios available | 2 | 5 | 6 |
| Operations in Darkness | All personnel | 3 | 6 | 12 | Sufficient lighting required before operations, halt if inadequate | 2 | 2 | 4 |
| Fire | All personnel | 2 | 3 | 6 | Fire plan in place, explained during induction, onboard fire extinguisher | 2 | 2 | 4 |
| Noise | All personnel | 2 | 3 | 6 | Hearing protection provided over 80dB, warning signage posted | 2 | 3 | 5 |
| Manual Handling | All personnel | 3 | 6 | 12 | Manual handling training, mechanical aids where possible, smaller loads, rotation system | 2 | 3 | 6 |
Compliance Statement
We (the undersigned) have read and understood the attached method statement and will comply with the specified requirements and control measures. If the work activity changes or deviates from that originally envisaged, we will seek further advice and request an amended method statement.
What Models Must Analyze
AI models are provided with similar work scenarios and must create or review Risk Assessment Method Statements. The analysis must demonstrate understanding of:
- •Work activities and associated tasks
- •Comprehensive hazard identification across all work phases
- •Risk assessment using standard matrices (likelihood × severity)
- •Appropriate control measures following hierarchy of controls
- •Residual risk evaluation after controls implemented
- •Compliance with relevant regulations and standards
Scoring Criteria
Certified safety professionals evaluate model responses across three key dimensions:
1. Completeness (40%)
All significant hazards identified, all work phases covered, and all required RAMS sections included
2. Accuracy (40%)
Correct risk ratings, appropriate control measures, proper application of hierarchy of controls, and accurate regulatory references
3. Quality & Usability (20%)
Clear documentation, practical recommendations, proper formatting, and immediate usability by site supervisors and workers