Getting Started with DeskDirector
Admin Console
Admin Console : Getting Started
Portal
Settings
Profile
Branding your DeskDirector Portal via Brand Packages
Color Theming a Portal via Brand Packages
Avatars in the DeskDirector Portal
Features
Enable/Disable Chat Callback Feature
Enable/Disable Pre-Ticket Chat
Enable or Disable the 'Something Else' Option
Embedding Media as the Help Page
User Groups
File Storage
Tickets
Permissions
Portal Permissions in DeskDirector
FastTrack in DeskDirector
Setting Up and Using the VIP Priority
How to setup the Flag feature (ConnectWise)
Have Approvals go to Approvers according to site (ConnectWise)
Quotes (ConnectWise)
Invoices (ConnectWise)
Request Types
Setting up Request Type Items
Request Type Ordering in the Client Portal
Getting Started with Request Type Groups
Forms
Getting started with DeskDirector Forms
DeskDirector Forms - Question Types in Detail
DeskDirector Forms - Dynamic Fields
DeskDirector Forms - Dynamic Fields Implementation Example
DeskDirector Forms - Sections and Conditionals
DeskDirector Forms - Embed content
DeskDirector Forms - Replace Summary Field with Title Automation
Importing Wufoo Forms to DD Forms
DeskDirector Forms - Dynamic content
DeskDirector Forms - Field value format for automation
Sharing Forms
Companies
User Groups
Managing Companies in DeskDirector
Filtering Companies to Manage
Exporting Companies as CSV
Contacts
Managing Contacts in DeskDirector
Exporting Contacts as CSV
Ticket Group Permissions
Contact Impersonation
Menu Group
Menu Items
Intro to Menu Items
Creating Menu Items
Extension Menu Security and Query Paramaters
Adding BiggerBrains Menu Item
Learning Center
Getting Started with the Learning Center
How to change the name of the Learning Center
Useful Learning Center Tips - Adding files from Google and Dropbox
Notebooks
Portal Access
Notifications
Desktop Installer
Feature Preview
Tech
Email Notifications Overview
Setting up Global Email Notification Settings
Setting up Office 365 Mail Delivery
Setting up SMTP Server Mail Delivery
Setting up SendGrid Email Delivery
Getting Started with Email Template Engine - DeskDirector
Creating Custom Email Template
Setting Email Templates for Notification Events
Email Templates Auto Login Link
HTML Email Templates - ConnectWise
HTML Email Templates - Autotask
Troubleshooting email delivery issues using "Delivery History"
System
Feature Configuration
Default Ticket Board and Source
Setting up your Approval Statuses
Adding a VIP Priority via the Admin Console
Automatic Contact Creation
Setting Reopened Ticket Status
Setting Status when Ticket is Closed
Change Ticket Status when Customer Adds Note
Hosts Configuration
PSA Integration (ConnectWise/Autotask)
Setting Office Hours
Enabling OAuth (Microsoft Login) for DeskDirector Portal
Logging in with Passwordless
Global Magic Token: Logging in via URL
Client Portal Office365 Single Sign-On
Switching from Custom Application OAuth to the new OAuth
Integrations
ConnectBooster
Wise-Pay
QuoteWerks
ConnectWise Sell (previously Quosal)
How to configure ConnectWise Sell (previously Quosal) Order Porter integration
Adding ConnectWise Sell (previously Quosal) Order Porter link to opportunity
Microsoft Flow (Power Automate)
Get started with the DeskDirector Power Automate Connector
Power Automate Administration
Power Automate Template Gallery
Featured Solution: Teams Ticket Discussion
Featured Solution: Ticket Briefing
DeskDirector Connector Triggers
Action: Create an email from template
Power Automate Connector - Setting up your first flow
Advanced
Deleting Orphaned Tickets
Developer Corner
Workflows
Managing Webhooks
ConnectWise API Integration Tester
Autotask Data Sync
Diagnose Entities Tool
Analytics
Account
Surveys
Task Lists
Service Agent Change Log
Auditing and Analytics
Contact Authentication Audit Log
Tech Portal
Tech Portal : Getting Started
Tickets
Managing Tickets from the Tech Portal
Tech Portal Ticket Details
Creating a Ticket from the Tech Portal
Request more information (forms request) with Task Forms
Enable/Disable Time Entry Timer Autostart
Broadcasts
Chat
Getting Started with DeskDirector Chat
Handling Chat Requests
Viewing Chat History from the Tech Portal
Creating a Chat Session from the Tech Portal
Changing your Presence
"Pre-Ticket Chat" Feature
"Call me Back" Feature
Macros
Notifications
Client Portal
Client Portal : Getting Started
Contact Support
Creating a Ticket from the Client Portal
Submitting a Generic Ticket
Creating a Chat Session from the Client Portal
Viewing Chat History from the Client Portal
Tickets
Approvals
Quotes & Invoices
Learning Center
BiggerBrains
Notifications
A walk through all the fields available in DeskDirector forms
Logging in to DeskDirector Workflow
Deskdirector - Sign up walk through
DeskDirector Roles and Permissions
Features
Tickets & Chats
Notifications & Broadcasts
Custom Forms & Request Types
Custom Branding
Custom Menus
Custom Email Templates
Surveys in DeskDirector
Approvals in DeskDirector
Easy Integrations
Advanced Authentication. No password, Single Sign On, MFA and beyond?
BiggerBrains & Learning Center
Analytics
Other DeskDirector Features
Ticket Dynamic Contents
How Tos & FAQs
APIs and Integration
ConnectWise SOAP API credential
Creating an Integrator Login in ConnectWise (SOAP API)
Creating a ConnectWise RESTful Integrator API Key
ConnectWise 2019.5+
Autotask integration major update 2022
ConnectWise Member Impersonation
Autotask Resource Impersonation
Creating an integrator API resource in Autotask
Autotask 2020.3 integration (API) resource migration
Third-party integration with DeskDirector
Authentication
How User Authentication works in DeskDirector
Setting/Resetting a Contact's Password
Logging in with Active Directory
Desktop Portal
Desktop Portal v4 Installation - For the Legacy App
Diagnosing DeskDirector Desktop Portal Issues
Diagnosing automatic login issues (ActiveDirectory) using the DDGetSID CLI tool
Antivirus Blocking DeskDirector Portal Installation
Troubleshooting your DeskDirector Portal installation
DD Portal for Mac: Labtech Deployment Guide
DDPortal removal tool - uninstalling Windows portals
Deploying DD Desktop Portal v5 via PowerShell
Desktop Portal v5 Installation & Common Issues
Instance & Account Queries
Setting up your custom domain
Contact Limits FAQs
Finding out what server your DeskDirector instance is on.
How search works in DeskDirector products
Portal and User Issues
User can't log in
DeskDirector Portal Browser Support
Contact can't login portal, the contact is missing in admin console but it is in ConnectWise
DeskDirector Tech Portal - How to take advantage of browser tabs
Add DeskDirector Tech Portal as a Custom Menu item inside ConnectWise Manage
Sign in with Microsoft Issue in Tech or Admin Console - "Need Admin Approval"
How do I add Tech Members/Contacts/Companies to my DeskDirector instance?
Time Stamps in DeskDirector Portal
Missing contacts or companies in DeskDirector but they are in my PSA
User Group FAQs
Chat permission granted but "Chat" option is missing on "Contact Support" page
How do we set a landing page for the client portal?
Tickets
User can't see "All Tickets" option
Tickets are missing in DeskDirector but they are on my PSA
My customer is seeing deleted tickets in portal
Ticket Description missing on ConnectWise emails
Other Articles
Top 10 Request Types
Generic vs Customized Request Types
Using Markdown
Desktop Portal (Installed client) Vs. Web Portal (Web Client)
Outdated Articles
Common WuFoo errors
Changing the Summary of Wufoo Tickets
Creating your first Wufoo form
Adding Wufoo Forms To Request Support
Getting started with WuFoo Forms
Debugging Your Wufoo Integration
Switching PSA or merging with another CW/AT instance
How to Allow Time Entries for StreamlineIT Members
Essential and Dynamic Plan Breakdown
Advanced Use
DeskDirector API
Subscribing to Chat Webhooks
Portal Deep Linking
Webhook Example with Zapier
Chat Session Payload
Legacy URL Linking in DeskDirector
Get started with portal extension page demo
Dynamic content based on logged in user
Clean Tickets
Exporting Portal Usage
TimeZest integration with DeskDirector
Troubleshooting Connectwise/Autotask-related integration issues
Release Notes
Client Portal
Server
Tech Portal
Portal Release Notes - Windows/macOS
Differences Between different Desktop Portal version
Portal Release Notes - Web Client
Release Notes in the Admin Portal
Glossary
Security
Microsoft Teams App
Introducing the DeskDirector for Microsoft Team App
Pre- Requisite - Unblock application in Teams Admin Portal
Installing the Microsoft Teams App (Tech)
Setting up a Tags for Teams Discussions (Tech)
Setting up DeskDirector for Microsoft Teams for your clients (Client mode)
Setting up Content Security Policy (CSP)
Branding the DeskDirector Teams App
Troubleshooting
Contact Support
Advanced topic: Setting up Tech & Client Mode in the same tenancy
- All Categories
-
- Debriefing and timeline of recent outage (March 31)
Debriefing and timeline of recent outage (March 31)
Updated
by Edcel Ceniza
We have recently confirmed that were was an outage that caused a fraction of our DD-US customer's instances to be unreachable. Here is the timeline and details of what actions were done from our end.
25th of March 2022
- Received first report of the issue from one customer. Degradation of performance lasts one hour on 5AM NZT
- Confirmed TECH portal, admin portal both experience slowness. Ruled out PSA API as the culprit.
- Checked last CPU and memory graph of the database for the past 24 hours. Nothing obvious was detected. AWS is unable to report correct memory usage. CPU is always under 60%
30th of March 2022
- The same customer and few other customer reported slowness. Degradation starts from 5AM NZT until 11:30AM NZT
- We noticed high CPU and memory usage on one of IIS VM. This indicates high usage on two of our customers.
- Diagnosed on query per seconds, ruled out the possibility of high usage by automation. There is little to no query done by automation through API key for these two instances
- Diagnosed on any query against that two instances, ruled out possibility of high usage by client or TECH portal. Their usage is around 13 request per seconds.
- Confirmed database web studio is slow.
- Confirmed database query is slow.
- Database was taking 700~800 request per seconds. This is expected, no issue here.
- Restart database didn't resolve the issue
- Upgraded database from 8 core and 64GB memory to 16 core and 127 GB memory on 4:30PM NZT. (Around 9PM USA West time)
31st of March 2022
- Several more customers reported slowness. Their instances now almost unusable for majority.
- Ruled out the under resourced server theory as hardware upgrade didn't resolve the issue.
- Checked disk I/O, no slowness detected
- Checked event log, nothing obvious detected. No error
- Database web studio is still slow
- Called database provider and had online session with them.
- Notice error report on database unable to write journal file, but this happened last Sunday.
- Created memory dump of database
- Recommended upgrade database from 5.1 to 5.3
- Restarted database, issue persisted
- 30 min after call with database provider, we have decided to upgrade database. Since this has affected several DD instances and were unusable
- Shut down database VM, did AWS snapshot on the disk. Since it is large region, it took almost 2 hours.
- Upgraded database and restarted.
- Disabled database daily backup.
- Slowness is gone.
Further diagnosis:
- From all the database history error log, ruled out the relationship of error with incident. Error on write lock on journal file is related to weekly windows update.
- Database daily backup setting display incorrect after upgrade to 5.3. But confirmed by database provide it is only UI error.
- From database log, daily backup only took around 1 hour each day on 6AM UTC. The slowness is not caused by backup.
Received first diagnose from database provider (9PM NZT), from memory dump, there seems to be corruption in database's heap memory. Whether it is related to the incident or not, they cannot 100% confirm that. Provider also cannot reproduce on latest version.
1st of April, 5AM NZT
- Verified that the database is no longer suffer degradation of performance. Database studio also load very fast. No other issues reported so far. Will monitor further
Plan
- Re-enable daily backup on 2nd of April, 4PM Sat NZT.
- Monitor database through automation, check if we still suffer from slowness.
- Setup schedule to upgrade all other database to latest version
---------------
2nd of April, 2022
- We tried to re-enable database backup, as soon as it is enabled, database suffer huge performance penalty.
- Disabled backup, no longer suffer performance penalty.
- Contacted database provider on our findings and scheduled to diagnose further
4th of April, 2022 NZT (USA Sunday).
- Spent whole day on diagnosing the database.
- Created many diagnose packages based on provider's instruction, either with backup on, or without backup.
- Verified how long before performance hit bottleneck after enabling backup.
- Disabled backup and waiting on further instruction from provider.
5th of April, 2022 night NZT, (USA Monday night)
- Spent 1.5 hours with provider to diagnose on live. The conclusion is the bottleneck might not be database fault but related to disk IO starvation.
- Reduce concurrent backup to 1, no more performance issue.
- Prepare for further diagnose on IO.
6th of April 2022
- Checking disk IO configuration and prepare for solution.
6th of April 2022 night NZT (USA Tue night).
- The performance issue start to raise again. Completely disabled backup.
7th of April 2022 morning, (USA Wed morning)
- The performance issue recurred without backup enabled. We have decided to switch disk to different type with higher consistent throughput. (double the throughput on US-2)
7th of April 2022, 3PM NZT, (11PM New York time, 8PM Los Angeles)
- Stopped database US-1 region, start whole disk backup
- Updated database on US-1 region to latest version
- Switched US-1 region's disk to higher version, also double the throughput than before.
- Moved 7 customers from US-2 region to US-1 region, to decrease load on US-2 region.
8th of April 2022, 8AM NZT (5PM)
- Verified last 12 hours IO load and database performance, no impact, no performance issue.
8th of April 2022, 3PM NZT (11PM New York time, 8PM Los Angeles)
- US-1, US-2, EU-1, CA-1 regions now uses additional disk for databse temp files. Decrease exist disk's IO stress
- EU, CA, AU region's IO throughput now been doubled
- US-1 region's IO throughput now been quadrupled compare to last week.
Future Plan:
- 9th of April afternoon, AU region database should have new temp file disk to decrease database load.
- 9th of April, we will re-enable US-2 region's database and close monitor on it.
- Closely monitor on US region in next 4 weeks, see whether problem occur again with IO throughput increased
- In the future, based on this event, we will setup measurement to review our infrastructure once a month, to make sure our hardware is sustainable with customer and usage increase.