In emergency response organizations like the fire service, personnel require easy access to reliable, up-to-date safety protocols. Systems for creating and managing Standard Operating Procedures (SOPs) within these command and control organizations are often rigid, inaccessible, and siloed. Open collaboration systems like wikis and social computing tools have the potential to address these limitations, but have not been analyzed for intra-organizational use in emergency services. In response to a request from the Fire Protection Research Foundation (FPRF) we evaluated a high-fidelity open collaboration system prototype, FireCrowd, that was designed to manage SOPs within the U.S. fire service. We use the prototype as a technology probe and apply human-centered design methods in a suburban fire department in the Chicago area. We find that organizational factors would inhibit the adoption of some open collaboration practices and identify points in current practices that offer opportunities for open collaboration in the future.