Rally started as a pure benchmark tool for OpenStack project.
During the last 8 months we grow from small script to quite a big testing tool, that allows you to produce clouds, verifies it (using tempest), benchmark it & generate reports.]
It seems like that we could build on this fundament an very interesting for Operators: 1) Verification 2) Health check 3) Track API performance 4) Track VMs performance (cpu/io/mem/network) 5) Periodic tasks 6) Analyze of ceilometer data 7) Integration with horizon + notifications (emails/sms) in case of something went wrong 8) Historical data reports