Benchmarks is an at-a-glance review tool designed to help you quickly spot missing terms in your contracts and ensure your document meets industry standards.

We've launched with a comprehensive library of over 2,000 standards for common contract scenarios, with pre-built rules for easy setup, and changes can be made to these rules in seconds. Plus, all of your edits are saved, so the next time you or anyone in your company uses the same standard, the updated rules will be in place, ensuring consistent use across your firm.

You can also create custom standards using a model document. Just upload your documents to Spellbook and we’ll auto-generate a comprehensive list of rules for you. Our standards editor allows you to edit suggested topics and rules for any standard or add your own.
​

Navigating unfamiliar contracts? Benchmarks provide an immediate understanding of the typical structure and risks of contracts, even ones you haven't dealt with before.

Through automated Benchmarks, Spellbook can quickly highlight the key areas of risk in a contract type, and help you ensure the typical risks have been covered. This reduces the time and effort needed to review unfamiliar documents, making your work more efficient.

Benchmarks is designed from the ground up to support in-house teams. You can quickly create custom standards based on your own model documents and templates, and all standards are default-shared across your organization to ensure consistency across contracts.

With minimal setup and maintenance, Benchmarks can automatically generate and apply a set of pass/fail rules tailored to your specific needs. This ensures that each contract adheres to your company's standards.

1. Click "Benchmark"

2. Spellbook will automatically analyze your document and based on the type of document it determines it to be, it will then give you a coverage score based on how your current document meets the standards.

3. You can quickly scroll down and see what is missing based on the different requirements.

4. Click "Go to" to see where in the document this applies.

5. Click "Show Fix" to see what Spellbook suggests as a fix for what it has flagged is missing.

6. Click "Insert Fix" to apply Spellbook's suggested fix into your document.

7. It will appear as a redline that you've added.

8. You can see what is missing by filtering your view and clicking Missed.

9. If you would like to change the standard Spellbook is comparing your document to, click "More Standards".

10. You can then select a Standard from Spellbook's Standard Library OR Standards saved by other team members in your firm who are using Spellbook.

11. Click "Firm Standards" to see the standards being used by others in your firm who are also using Spellbook.

12. You can also create your own custom Standard by clicking "Create a Standard"

13. You can open another template document to save as a Standard. Simply repeat the steps above to open Benchmarks and generate a new standard, then click "Current Document". This will generate standards based on the document you have opened that you can use to compare future documents to.

14. Or to generate your own custom standards, you can click "Upload Document" and create standards from another document.

15. Click "Browse" to select a document you want to use as a standard.

16. Click "Upload"

17. Click "Create Standard" and it will generate benchmark standards for you to compare your current document against.

18. Once the standards are generated from your template document, you can edit the standards and add rules. Click on the section title to edit the Topic text.

19. You can also edit the rules by clicking into the sections and typing in your changes. It will automatically save for you.

20. You can add rules to your custom standards by clicking "Add Rule"

21. Type in your desired rule. You can also remove any rules by clicking the garbage icon to delete it.

22. Click "Save Custom Standard" to save the standard you've just customized.

23. To then compare your current document to the custom standard you generated, click "Run Benchmark With This Standard"

What are Benchmarks?

Benchmarks is an at-a-glance review tool that helps you spot gaps in your contract’s term coverage. When you load a contract in Spellbook, Benchmarks automatically checks your document’s term coverage against a standard for your contract type.

​What are Spellbook standards?

Standards contain pre-built pass/fail rules around different topics (or risk areas) that are typically covered in certain contracts. We’ve built a comprehensive library of standards based on these common contract scenarios that you can run Benchmarks against.

​How are Spellbook standards generated?

Spellbook has a proprietary Rules Engine that uses LLMs to generate standards for specific types of contracts. The Rules Engine is optimized to focus on salient details in contracts rather than boilerplate terms. It generates standards by creating a list of topics typically found in a type of contract, and then creating a list of specific rules around each of these topics.

​How does Spellbook determine which standard is most relevant to my contract?

Every Spellbook standard has a name and description. To find the most relevant standard, we first generate a name and description for your currently opened document. We then compare the open document name + description against the names and descriptions of all standards in our database.

Finally, we apply a bonus factor for more heavily used, and more heavily customized standards. In other words, if you’ve used or edited a standard before that might be relevant for your contract type, Spellbook will prioritize that match. Once a high scoring standard is found, we will calculate a Benchmark using that standard automatically; otherwise, we'll use the Spellbook Rules Engine to generate a new standard for your contract type.

​How is the Benchmark Score calculated?

Benchmarks measures how many of the rules in the standard were covered in your document and assigns you a Benchmark coverage score as a percentage. This gives you a clear indication of what terms might be missing in your contract. To improve your score, click the circular checkbox beside each rule to mark it as checked. In doing so, your Benchmark score will update in real time.

​How do I see what terms passed or failed the Benchmark?

In the Benchmarks tab, you’ll see a list of rules under your Coverage Score. You can toggle between the All Terms view, which includes rules that passed and failed, or the Missed view only to quickly action on terms that were missed.

​How do rules and topics work?

Topics represent risk areas in your contract and contain a set of pass/fail rules. Each rule contains a title and description for further context. You can also click ‘Go to’ which takes you to the section of the contract it’s referencing. Our Rules Engine also offers a Suggested Fix which you can reveal and then optionally click ‘Insert Fix’ to which then redlines it in your document.

​Can I create my own standard?

Yes. You can create your own custom standard by clicking the Create a Standard button on the Standard Selector card in the Benchmarks tab. Then, you can choose to create a standard by using your opened document as a model document or by uploading your own template.

When you create a standard in this way, Spellbook will derive a set of rules with the assumption that the model document contains your best practices. This process is flexible - it can take in either contracts or simple playbooks - but the core assumption is that rules will be created assuming the model document is the ideal.

​How do I choose a different standard?

We’ve built a comprehensive library of standards you can pick from. To select a different standard, click the More Standards button on the Standard Selector card. You’ll then be redirected to the Select a Standard pane where you can choose between Firm Standards or Spellbook Standards.

​Are standards shared across my team?

Yes. All Spellbook standards - including custom standards - default to shared across your team. The individual standards in the Select a Standard pane also contain usage data, including when a standard was last used and which teammates have used it before. This helps ensure consistent use of standards across your team.

​What’s the difference between a Spellbook Standard and Firm Standard?

Spellbook standards are pre-made standards built using the Spellbook Rules Engine. Firm Standards are where you can access any custom standards you’ve generated using model documents or based on a document type.

If you make any edits or customizations to a Spellbook Standard, they will automatically be displayed in the Firm Standards view for easy access.

​I can’t find a relevant standard in the Spellbook library for my contract, and I don’t have a model document to go off of. What should I do instead?

If you’re dealing with an unfamiliar contract, Spellbook gives you the option to generate a standard based on your document type. To do that, click the More Standards button on the Standard Selector card to visit the Select a Standard pane, then click ‘Generate’. In doing so, Spellbook will create a standard based on a list of typical topics and rules for your document type.

​I’ve made edits to my document. How do I make my Benchmark score reflect those changes?

Click ‘Re-run Benchmark’ on the top right of the Standard Selector card in the Benchmarks tab. This will re-run Benchmark using the standard currently selected and update your Benchmark score.

​I ran a Benchmark, but I got a very low score. My contract is fine though - what is going on?

The standards are designed to be very comprehensive - far more comprehensive than the typical contract really needs to be. The first time you run a Benchmark, it’s likely the extremely comprehensive ruleset leads to a lot of ‘failing’ rules.

If it’s more comprehensive that you need, we recommend editing the standard to your needs by clicking the edit button beside the standard name in the Standard Selector card. This takes you to the Edit a Standard flow that allows you to edit/delete any rules you don’t find useful so that the contract is tuned to your style.

​How is my data stored/processed?

The initial prebuilt standards are visible to everyone. Spellbook will collect data on the ‘standard ruleset’ from all firms, and this may be used to calculate things like rule “hit rates”. eg: What % of employment contracts analyzed by Spellbook pass a specific rule in the contract.

Any standard customized by a user will have that customization saved at the firm level. If there are 2 lawyers in an office, and one modifies any of a standard’s rules, then the other lawyer will see the updated rule in the future. These updated rules are never shared with any third parties, and data about hit rates from these updated rules are localized to only your firm.