Skip to content
Zarif Automates

Enterprise AI Knowledge Management: A Practical Selection and Pilot Guide

ZarifZarif
|Published |Updated

An employee asks which refund policy applies to a customer. The answer sounds right, cites a document and arrives quickly. It still fails if the document is obsolete, belongs to another team or describes a policy the employee cannot use.

That is the selection problem for enterprise knowledge management. For a forward-deployed engineer, the work is to connect the right sources, establish who can use them, and prove that answers survive ordinary changes to the business. A polished search box is only the visible part.

This is a source-based comparison of four starting points, checked September 17, 2026. The product descriptions below come from official documentation. The pilot and acceptance criteria are proposed exercises, not results from a shared vendor benchmark.

Choose the operating model first

Start with one team and one recurring decision. “Search all company knowledge” hides disagreements about ownership, sensitive content and which document is authoritative. “Help support staff find the applicable refund policy, with an inspectable citation” gives the implementation a clear purpose.

Starting pointCandidate to investigateQuestion to resolve before connecting data
Search across several existing systemsGleanWhat does each specific connector index, and whose permissions does it enforce?
A managed knowledge program with explicit source accessGuruWill access follow Guru Groups or inherited source permissions?
Work already organized in NotionNotion Enterprise SearchWhich connected sources, identity mappings and update delays fit the workflow?
Microsoft 365 is the employee workspaceMicrosoft 365 Copilot connectors and searchIs content synced into an index or fetched at query time, and which access mode is configured?

These are fit hypotheses. They are not a ranking of answer quality, implementation speed or total cost. A team with a narrow document-processing problem may instead need an extraction pipeline; a system that changes business records needs an agent execution platform as well as retrieval.

Glean: inspect the connector, not just the platform promise

Glean is worth investigating when the problem spans multiple established systems. Its connector documentation gives implementation details that are more useful than a count of supported applications.

The Notion connector illustrates why that inspection matters. Glean documents a shared index of pages given to the integration. That indexed corpus does not reproduce individual Notion page permissions: content is visible to Glean users who can access the connector. Its separate per-user retrieval path uses the user's Notion authorization. Those are materially different access models. Glean Notion overview.

For an FDE, the consequence is concrete: granting an indexing integration access to a private team page can change the audience for that content. Check the selected pages, child-page inheritance and connector visibility before using any sensitive data. A successful query from an administrator is not an access-control test.

Glean's overview describes an administrator enabling Live Mode; its troubleshooting page says setup has no retrieval-mode switch, indexing is required, and users authorize tools individually. Confirm which controls the tenant actually exposes and whether indexing can be disabled before designing around live-only retrieval. Notion troubleshooting.

In your pilot, have the implementation team demonstrate a restricted document, a revoked user and a removed page with the exact connector mode being proposed, then record how long each change takes to affect results. Do not generalize one connector's behavior to the rest of the platform.

Guru: decide who owns the access policy

Guru documents two ways to grant access to connected sources. Under the Guru Groups model, an administrator assigns the groups that may use content indexed through the connecting account. For supported sources, inherited permissions instead follow native source access. The first model can intentionally expose information to people who do not have a seat in the source application; it therefore needs an explicit business decision. How sources work in Guru.

This distinction is useful when a knowledge team wants to curate an approved information set for another audience. It is also easy to overlook if everyone assumes that connecting an application automatically preserves every permission.

Name a source owner, choose the permission model and test an ordinary reader account. Then test maintenance: update a policy, move a file out of scope, revoke the connecting account and inspect the sync state. Guru says update timing varies by source and volume; it also warns that moving a file outside a synced folder can take time to remove it from search. Agree on what happens during that interval before rollout.

A curated knowledge process is valuable only if someone owns outdated and conflicting material. Assign that work explicitly rather than treating an AI answer as a substitute for source ownership.

Notion: keep search scope and source freshness visible

Notion Enterprise Search is available on Business and Enterprise plans and can combine workspace content with connected applications. Its interface lets a user choose sources and control web search. That matters for testing: an answer drawn from the public web is a different result from an answer grounded in the customer's internal policy. Notion Enterprise Search.

Notion describes permission checks and identity mapping for connected applications, while noting that permission synchronization is periodic and connector-specific. Its security documentation discusses delays after permission changes and deletion. The same page uses different wording about when deleted content becomes unsearchable, so do not turn those statements into an immediate-revocation guarantee. Verify the particular connector and agree on the required behavior with the vendor. Search security and privacy.

For the pilot, fix the source scope, use separate permitted and unpermitted accounts, and save the cited document IDs. A source citation helps a reviewer inspect an answer; it does not prove the cited text supports the answer or that a later access change has propagated.

Notion is a sensible candidate when it is already the team's working environment, but source coverage, formats and operating controls still decide whether it fits.

Microsoft: verify the configured visibility model

Microsoft 365 Copilot connectors bring external content into the Microsoft experience. Microsoft distinguishes synced connectors, which index content, from federated connectors, which retrieve it at query time. Availability and setup differ, so identify the actual connector model in the proposal. Connector overview.

The access setting is consequential. Microsoft documents a source-permission option and a setting that makes connected content visible to everyone in the organization. It warns that the latter can overshare sensitive information. The same guide says changing this permission choice currently requires recreating the connection. Build that choice into the design review before a large ingestion. Manage access permissions.

Use the index browser to inspect an item's status, refresh time, properties and access lists. This gives a useful diagnostic path when the answer is missing or unexpectedly visible: first establish whether the item was indexed with the intended metadata and permissions. Validate indexed content.

An existing Microsoft environment can simplify ownership and administration. It does not resolve incorrectly shared source documents or a connector configured for the wrong audience.

Run a pilot that exposes the hard parts

Use synthetic documents first. Create two teams, a support reader and a policy owner. Give the reader access to a current refund policy, an older version and a general support article. Keep a separate management-only exception policy restricted.

Write the expected source and acceptable answer before trying each question. Preserve the account, question, connector mode, source state, returned citations, answer and observation time. A useful initial matrix is:

TestEvidence to retainFailure to investigate
Ask the ordinary refund questionCurrent policy and supporting passageOld policy preferred because its wording matches better
Ask using a synonymRetrieved IDs and answer or abstentionNo evidence found, followed by a confident invented answer
Ask about a nonexistent exceptionVisible unsupported stateAn answer assembled from unrelated policies
Reader requests the restricted exception policyNo restricted content in answer, snippet or citationAccess enforced only when opening the source link
Revoke the reader's accessBefore/after results and elapsed timePermission change has not reached the retrieval path
Delete or replace a policySource state, index state and results over timeStale content remains usable after the agreed interval
Disconnect a source in the test workspaceExplicit unavailable or limited-coverage behaviorAn outage is presented as a complete answer
Put contradictory instructions in a documentSource content treated as evidence, not authorityRetrieved text changes the system's access or action rules

This is an acceptance plan, not a claim that every product exposes every diagnostic field. Missing observability is itself a question for the vendor. Use test accounts and non-sensitive documents until the access behavior is understood.

Measure usefulness without hiding serious failures

Separate answerable questions from questions that should be refused or left unanswered. Report supported answers over answerable questions, correct abstentions over unsupported questions, and the count of unauthorized disclosures. Do not bury an access failure inside an average satisfaction score.

Have the business reviewer judge whether an answer enables the intended decision. Finding a relevant document and resolving the customer's question are different outcomes. Record the reason for each rejected answer: outdated evidence, missing context, wrong audience, unsupported inference or an unusable citation.

Measure elapsed time and review effort against the current process using the same tasks. Label the sample and conditions. A small synthetic pilot validates the method and exposes defects; it does not establish a company-wide productivity gain.

Hand off a maintainable knowledge service

The handoff should include a source inventory with owners, connector identities, intended audiences, sync behavior, deletion expectations, test cases and escalation contacts. Define who resolves contradictory policies and who can pause a connector when an access test fails.

Estimate the whole cost: licenses or usage, ingestion, implementation, review, ongoing source maintenance and incident handling. Ask what happens when the corpus grows, a new team is added or a contract ends. There is no reliable cross-vendor cost comparison without those assumptions.

A sound starting point is the platform the customer can operate with the least additional complexity, provided it passes the required source and access tests. The strongest demo is one where the team can explain both a correct answer and a deliberate failure, then show how they repair it.

For customer delivery, continue with the forward-deployed engineering playbook.

Get the launch announcement and future updates on useful sources, AI engineering, and careers. No fixed schedule.

Zarif

Zarif

Zarif builds AI agents and automation workflows and writes about what holds up in production: the sources worth following, the roles the AI era is creating, and agent workflows you can inspect end to end.