Will Chatbots Take Over HR Tech? Paradox Sets The Pace.在快速发展的人力资源技术领域，Paradox.ai 已成为领跑者，其先进的对话式人工智能平台彻底改变了招聘流程。通过利用自然语言处理和人工智能，Paradox.ai 提供了一个全面的解决方案，涵盖了从最初的职位申请到入职的整个招聘过程。该平台不仅简化了筛选和面试安排等繁琐流程，还提升了应聘者的整体体验，显著改善了招聘时间和招聘质量指标。
Paradox.ai 由亚伦-马托斯（Aaron Matos）于 2016 年创立，目前为联合利华、CVS Health 和通用汽车等大客户提供服务，实现了 90% 以上的招聘流程自动化。
Paradox.ai 凭借其强大的集成能力和大幅缩短招聘时间、降低招聘成本的能力，在人力资源技术领域充分体现了对话式人工智能的变革力量。
Chatbots used to be tinker-toys. You type, try to get help, but usually result in “please call support.” Well all this has changed.
Thanks to advanced NLP (natural language processing) and AI (retrieval-augmented generation) chatbots are entire applications. They can answer complex questions, search databases, and invoke transactions on your behalf.
Pretty soon we’ll be able to ask our phones “please find me a flight to Los Angeles next Tuesday morning” and the system will check your location and calendar, look at flights, and book you a seat.
Where is this going in HR? Well the leader in this space is Paradox.ai, a company that pioneered the application of conversational AI in recruiting. And their system “defines the category.”
Let me explain.
Recruiting Is The Perfect Market For Conversational AI
Recruiting is a goldmine for automation. When you post a job, applicants want to ask many predictable things: “How much does it pay?” “What are the hours?” or “What uniform do I need” or “What are the benefits?”
The recruiter, a person devoted to filling positions, has to answer all these questions and more. They have to screen candidates, schedule interviews, check for qualifications, and look at credentials, experience, and more. It’s time-consuming, error-prone, and filled with wasted time. (That’s why talent acquisition teams have many “scheduler” and admins.)
The average “time to hire” is over 45 days and often the process goes on for months. And throughout the experience the job seeker is left wondering “when will they call back” or “what else do I need to know?”
(CEOs cite hiring as the third most time-wasting process in companies, following emails and meetings, estimated at “40% wasted time.”)
Paradox uses Conversational AI to solve this problem. And because this is a “narrow but deep” space, the system does many things we can learn from in all our AI efforts.
Paradox was founded by Aaron Matos in 2016. Aaron’s vision was to transform the candidate experience, revolutionizing the way candidates apply to jobs. Today Paradox has become a complete Conversational AI Recruitment Platform (chat to apply, scheduling, candidate support, ATS, assessments, onboarding, career site, and more), serving clients like Unilever, CVS Health, Pfizer, L’Oreal, Nestle, McDonald’s FedEx, Compass Group, Disney, and General Motors.
The platform automates tasks such as screening for requirements, interview scheduling, reminders, offers, and new hire onboarding. And because it’s so easy to use, it helps companies radically improves time-to-hire and quality of hire. Based on my conversations with clients, Paradox can automate more than 90% of the end-to-end hiring process, saving hiring managers hours every week and increasing candidate conversion by more than 10 times.
But this innovation did not happen overnight. As you know, going to a candidate website and looking for a job is a frustrating process. There are often hundreds of jobs listed, a complex scrolling website and very hard to even determine what job to apply for.
You might argue that the website paradigm for job applications was never really a good idea in the first place. People don’t want to browse for jobs: they want to apply for a job that’s best for them. So the first thing Paradox did was create an easy to use assistant (Olivia) so candidates could ask questions and schedule interviews. And this meant that Paradox had to build integrations with every ATS and personal email and calendar tools out there.
Then, as companies started to use Paradox for scheduling, the company added more. Today Olivia, the chatbot, can integrate with background check vendors, schedule interviews, deliver assessments (Paradox acquired a conversational assessment Traitify designed for this), and function as an ATS … all from a mobile phone. In many ways Paradox can be “the integration platform” for candidates and recruiters, stitching together the messy systems behind the scenes.
This turned into a massive opportunity. Just as the Google Assistant or Siri hopes to be our single contact with the internet, Paradox partners with systems of record like Workday, SAP, and Oracle to bring conversational AI to any company. The company’s revenues have grown 11 times in the last four years, and are now nearly doubling each year.
For customers Paradox has been amazing. As the candidate pipeline speeds up (by an order of magnitude), clients get higher quality candidates with dramatically reduced staff. (Staffing administrators can almost go away.)
Consider high-volume hiring companies. These businesses (McDonald’s, Compass Group, Neighborly, FedEx, Disney) hire service-related workers on a regular basis. Their revenue is dependent on having enough people. With Paradox they can set up a “continuous recruitment process,” one that even hires people the same day they apply.
Paradox has become essential to these companies growth, often paying for itself in less than a year (through reduced hiring staff, reduced spend on job ads, and reduced turnover.)
Today, as Paradox built out its ATS, customers can rely on the platform to integrate front end tool (job portals and candidate support) to back end tools scheduling, ATS, onboarding) most of which are legacy. One of our clients has 27 recruiting tools and they anticipate replacing more than half of them with a platform like Paradox.
What about higher level white collar roles? Paradox works here too. General Motors uses Paradox along with Workday (ATS), (branded Evie) to redesign the process.
Interview Scheduling: Evie automates scheduling of phone screens and interviews between recruiters, candidates, and internal teams. This has reduced the time taken for interview scheduling from an average of five days to 29 minutes.
Candidate Experience: Evie interacts with candidates from the moment they land on GM’s career site until the completion of their interview. Candidates appreciate the immediate communication from Evie after they apply or complete an interview, and enjoy the autonomy to select and change interview times.
Efficiency and Cost Savings: The automation of interview scheduling has led to a major reduction in the cost of external contractors for coordination.
Career Site Interaction: Evie sits on GM’s career site, answering questions from potential candidates about jobs, benefits, and company culture. This interaction enhances the candidate’s experience and provides them with immediate responses to their queries.
Where Is Paradox Going
The company is perfectly positioned to continue its growth as companies look for AI solutions to improve the productivity and effectiveness of recruiting. And demand is high: the 2024 PwC CEO survey found that recruiting was considered the #3 “most bureaucratic process” by CEOs (following email and meetings).
The impact on recruiters? All positive. Clients tell us they can redeploy hiring staff to help recruiters focus on the most important part of their job: talking with candidates.
But there’s a much bigger story. When a job candidate is handled efficiently and effectively the process becomes a brand-builder for the candidate, improving quality of hire. Ambitious job seekers will not put up with (or wait for) a messy, confusing hiring process. So not only is the process faster and more efficient, the quality of hire goes up.
Companies are desperately looking for AI solutions that work. As Paradox has proven, when you focus deeply on the problem, conversational AI can be transformational.
Listen to my conversation with Adam Godson (CEO) and you’ll hear the details. This is where the HR Tech market is going.
efficiency
2024年04月04日
efficiency
How Generative AI Adds Value to the Future of Work
这篇Upwork的文章深入探讨了生成式人工智能（AI）在重新塑造工作价值方面的变革力量，强调了自动化和创新不仅改变了工作岗位，还在各个行业提高了生产力和创造力。文章着重讨论了对劳动力市场的细微影响，强调了技能发展和道德考虑的重要性，并对人工智能与人类合作的未来提供了前瞻性的视角。
Authors: Dr. Ted Liu, Carina Deng, Dr. Kelly Monahan
Generative AI’s impact on work: lessons from previous technology advancements
In this study, we provide a comprehensive analysis of the initial impact of generative AI (artificial intelligence) on the Upwork marketplace for independent talent. Evidence from previous technological innovations suggests that AI will have a dual impact: (1) the displacement effect, where job or task loss is initially more noticeable as technologies automate tasks, and (2) the reinstatement effect, where new jobs and tasks increase earnings over time as a result of the new technology. Take for example the entry of robotics within the manufacturing industry. When robotic arms were installed along assembly lines, they displaced some of the tasks that humans used to do. This was pronounced in tasks that were routine and easy to automate. However, new tasks were then needed with the introduction of robotics, such as programming the robots, analyzing data, building predictive models, and maintaining the physical robots. The effects of new technologies often counterbalance each other over time, giving way to many new jobs and tasks that weren’t possible or needed before. The manufacturing industry is now projected to have more jobs available as technologies continue to advance, including Internet of Things (IoT), augmented reality, and AI, which transform the way work is completed. The issue now at hand is ensuring enough skilled workers are able to work alongside these new technologies.
While this dynamic of displacement and reinstatement generally takes years to materialize, as noted above in the manufacturing example, the effects of generative AI may be taking place already on Upwork. For the platform as a whole, we observe that generative AI has increased the total number of job posts and the average spend per new contract created. In terms of work categories, generative AI has reduced demand in writing and translation, particularly in low-value work, while enhancing earnings in high-value work across all groups. In particular, work that relies on this new technology like Data Science and Analytics are reaping the benefits. The report highlights the importance of task complexity and the skill-biased nature of AI's impact. Skills-biased technology change is to be expected as the introduction of new technologies generally favors highly skilled workers. We observe this on our platform as high-skill freelancers in high-value work are benefiting more, while those in low-value work face challenges, underscoring the need for skilling and educational programs to empower freelancers to adapt and transition in this evolving work landscape.
Understanding the lifecycle of work on Upwork and the impact of gen AI
Generative AI has a growing presence in how people do their work, especially since the public release of ChatGPT in 2022. While there’s been extensive discussion about the challenges and opportunities of generative AI, there is limited evidence of such impact based on transaction data in the broader labor market. In this study, we use Upwork’s platform data to estimate the short-term effects of generative AI on freelance outcomes specifically. The advantage of the Upwork platform is that it is in itself a complete marketplace for independent talent, as we observe the full life cycle of work: job posts, matching, work execution, performance reviews, and payment. Few other instances exist where a closed-system work market can be studied and observed. Thus, the results of this study offer insights into not only the online freelance market, but also the broader labor market.
How technological progress disrupts the labor market is not a new topic. Acemoglu and Restrepo (2019) argue that earning gain arises from new tasks created by technological progress, which they term the “reinstatement effect,” even if the automation of certain tasks may have a displacement effect in the labor market initially. What this means is that there may be a dynamic effect going on: the displacement effect (e.g., work loss) may be more noticeable in the beginning of a new technology entry, but as new jobs and tasks are being created, the reinstatement effect (e.g., rates increase, new work) will begin to prevail. In the broader labor market, such dynamics will likely take years to materialize. But in a liquid and active independent work marketplace like Upwork, it’s possible that we’re already observing this transition happening.
Existing studies such as this provides a useful conceptual framework to think about the potential impact of generative AI. It’s likely that in the short term, the replacement of generative AI will continue to be more visible, not just at Upwork, but also in the broader labor market. Over time and across work categories, however, generative AI will likely spur new tasks and jobs, leading to the reinstatement effect becoming stronger and increasing rates for those occupations with new tasks and a higher degree of task complexity. We’ve already seen evidence of new demand as a result of gen AI on our Upwork platform, with brand new skill categories like AI content creator and prompt engineer emerging in late 2022 and early 2023. We test this hypothesis of both work displacement and reinstatement, and provide insights into how generative AI affects work outcomes.
Impact of generative AI on work
To understand the short-term impact of generative AI on the Upwork freelance market, we capitalize on a natural experiment arising from the public release of ChatGPT in November 2022. Because this release was largely an unanticipated event to the general public, we’re able to estimate the causal impact of generative AI. The essential idea behind this natural experiment is that we want to compare the work groups affected by AI with the counterfactual in which they are not. To implement this, we use a statistical and machine-learning method called synthetic control. Synthetic control allows us to see the impact that an intervention, in this case, the introduction of gen AI, has on a group over time by comparing it to a group with similar characteristics not exposed to the intervention. The advantage of this approach is that it allows us to construct reasonably credible comparison groups and observe the effect over time.
The units of analysis we use are work groups on the Upwork platform; we analyze variables such as contract number and freelancer earnings. Instead of narrowly focusing on a single category like writing, we extend the analysis to all the major work groups on Upwork. Moreover, we conduct additional analysis of the more granular clusters within each major group. The synthetic control method allows for flexibility in constructing counterfactuals at different levels of granularity. The advantage of our comprehensive approach is that we offer a balanced view of the impact of generative AI across the freelance market.
Generative AI’s short-term impact on job posts and freelancer earnings
Looking at the platform as a whole, we observe that generative AI has increased the total number of job posts by 2.4%, indicating the overall increased demand from clients. Moreover, as shown in Figure 1, for every new job contract, there is an increase of 1.3% in terms of freelancer earnings per contract, suggesting a higher value of contracts.
Figure 1 Effect of Generative AI on Freelancer Earning per Contract
The Upwork platform has three broad sectors: 1. Technological and digital solutions (tech solutions); 2. Creative & outreach; 3. Business operations and consulting. We have observed both positive and negative effects within each of the sectors, but two patterns are worth noting:
The reinstatement effect of generative AI seems to be driving growth in freelance earnings in sectors related to tech solutions and business operations. In contrast, within the creative sector, while sales and marketing earnings have grown because of AI, categories such as writing and translation seem disproportionately affected more by the replacement effect. This is to be expected due to the nature of tasks within these categories of work, where large language models are now able to efficiently process and generate text at scale.
Generative AI has propelled growth in high-value work across the sectors and may have depressed growth in low-value work. This supports a skills-biased technology change argument, which we’ve observed throughout modern work history.
More specifically and within tech solutions, data science & analytics is a clear winner, with over 8% of growth in freelance earnings attributed to generative AI. This makes sense as the reinstatement effect is at work; new work and tasks such as prompt engineering have been created and popularized because of generative AI. Simultaneously, while tools such as ChatGPT automate certain scripting tasks (therefore leading to a replacement effect), it mainly results in productivity enhancements for freelancers and potentially leads to them charging higher rates and enjoying higher overall earnings per task.
In terms of contracts related to business operations, we observe that accounting, administrative support, and legal services all experience gains in freelance earnings due to generative AI, ranging from 6% to 7%. In this sector, customer service is the only group that has experienced reduced earnings (-4%). The reduced earnings result for customer service contracts is an example of the aggregate earnings outcomes of AI, related to the study by Brynjolfsson et al (2023), who find that generative AI helps reduce case resolution time at service centers.
A potential outcome of this cut in resolution time is that service centers will need fewer workers, as more tasks can be completed by a person working alongside AI. At the same time, the reinstatement effect has not materialized yet because there are no new tasks being demanded in such settings. This may be an instance where work transformation has not yet been fully realized, with AI enabling faster work rather than reinventing a way of working that leads to new types of tasks. A contrasting case is the transformation that happened with bank tellers when ATMs were introduced. While the introduction of these new technologies resulted in predictions of obsolete roles in banks, something different happened over time. Banks were able to increase efficiency as a result of ATMs and were able to scale and open more branches than before, thereby creating more jobs. In addition, the transactional role of a bank teller became focused on greater interpersonal skills and customer relationship tasks.
When taken together, the overall gains in such business operations work on Upwork are an encouraging sign. These positions tend to require relatively intensive interpersonal communication, and it seems the short-term effects of generative AI have helped increase the value of these contracts, similar to what we saw in the banking industry when ATMs were introduced.
As of now, the replacement effect of AI seems more noticeable in creative and outreach work. The exception is sales and marketing contracts, which have experienced a 6.5% increase in freelance earnings. There is no significant impact yet observed on design. For writing and translation, however, generative AI seems to have reduced earnings by 8% and 10% respectively. However, as we will discover, task complexity has a moderating effect on this.
High-value work benefit from generative AI, upskilling needed for low-value work
Having discussed the overall impact of generative AI across categories, we now decompose the impact by values. The reason we’re looking at the dimension of work value is that there may be a positive correlation between contract value and skill complexity. Moreover, skill complexity may also be positively correlated with skill levels. Essentially, by evaluating the impact of AI by different contract values, we can get at the question of AI's impact by skill levels. This objective is further underscored by a discrepancy that sometimes exists in the broader labor markets – a skills gap between demand and supply. It simply takes time for upskilling to take place, so it’s typical for demand to exceed supply until a more balanced skilled labor market takes place. It is worth noting, however, freelancers on the Upwork platform seem more likely than non-freelancers to acquire new skills such as generative AI.
For simplicity, let’s assume that the value of contracts is a good proxy for the level of skill required to complete them. We’d then assume that high-skill freelancers typically do high-value work, and low-skill freelancers do low-value work. In other words, our goal is also to understand whether the impact of generative AI is skills-biased and follows a similar pattern from what we’ve seen in the past with new technology disruptions. Note that we’re focusing on the top and bottom tails of the distribution of contract values, because such groups (rather than median or mean) might be most susceptible to displacement and/or reinstatement effects, therefore of primary concern. We define high-value (HV) work as those with $1,000 or more earnings per contract. For the remaining contracts, we focus on a subset of work as low-value (LV) work ($251-500 earnings).
Figure 2 shows the impact of AI by work value, across groups on Upwork. As we discussed before, writing and translation work has experienced some reduction in earnings overall. However, if we look further into the effect of contract value, we see that the reduction is largely coming from the reduced earnings from low-value work. At the same time, for these two types, generative AI has induced substantial growth in high-value earnings – the effect for translation is as high as 7%. We believe the positive effect on translation high-value earning is driven by more posts and contracts created. In the tech solutions sector, the growth in HV earnings in data science and web development is also particularly noticeable, ranging from 6% to 9%. Within the business solutions sector, administrative support is the clear winner.
There are two takeaways from this analysis by work value. First, while we’re looking at a sample of all the contracts on the platform, it’s possible that the decline of LV work is more than made up for by the growth of HV work in the majority of the groups. In other words, except for select work groups, the equilibrium results for the Upwork freelance market overall seem to be net positive gains from generative AI. Second, if we assume that freelancers with high skills (or a high degree of skill complexity) tend to complete such HV work (and low-skill freelancers do LV work), we observe that the impact of generative AI may be biased against low-skill freelancers. This is an important result: In the current discussion of whether generative AI is skill-based, there exists limited evidence based on realized gains and actual work market transactions. We are one of the first to provide market-transaction-based evidence to illustrate this potentially skill-biased impact. Finally, additional internal Upwork analysis finds that independent talent engaged in AI-related work earn 40% more on the Upwork marketplace than their counterparts engaged in non-AI-related work. This suggests there may be additional overlap between high-skill work and AI-related work, which can further reinforce the earning potential of freelancers in this group.
Figure 2
Case study: 3D content work
To illustrate the impact of generative AI in more depth, we have conducted a case study of Engineering & Architecture work within the tech solutions sector. The reason is that we want to illustrate the potentially overlooked aspects of AI impact, compared with the examples of data science and writing contracts. This progress in generative AI has the potential to reshape work in traditional areas like design in manufacturing and architecture, which rely heavily on computer-aided design (CAD) objects, and newer sectors such as gaming and virtual reality, exemplified by NVIDIA's Omniverse.
Based on activities on the Upwork platform, we see that there is consistent growth of job posts and client spending in this category, with up to 12% of gross service value growth year over year in 2023 Q3, and over 11% in job posts during the same period. Moreover, applying the synthetic control method, we show a causal relationship between gen AI advancements and the growth in job posts and earnings per contract. More specifically, there is a significant increase in overall earnings because of AI, an average 11.5% increase. Additionally, as shown by Figure 3, the positive effect also applies to earning per contract. This indicates a positive impact on freelancer productivity and quality of work, due to the fact that we’re measuring the income for every unit of work produced. This suggests that gen AI is not just a facilitator of efficiency but also enhances the quality of output.
Figure 3 Effect of Generative AI on Freelancer Earning per Contract in EngineeringIn a traditional workflow to create 3D objects without generative AI, freelancers would spend extensive time and effort to design the topology, geometry, and textures of the objects. But with generative AI, they can do so through text prompts to train models and generate 3D content. For example, this blog by NVIDIA’s Omniverse team showcases how ChatGPT can interface with traditional 3D creation tools.
Thus, the positive trajectory of generative AI in 3D content generation we see is driven by several factors. AI significantly reduces job execution time, allowing for higher productivity. It facilitates the replication and scaling of 3D objects, leading to economies of scale. Moreover, freelancers can now concentrate more on the creative aspects of 3D content, as AI automates time-consuming and tedious tasks.
This shift has not led to a decrease in rates due to the replacement effect. In fact, this shift of workflow may create new tasks and work. We will likely see a new type of occupation in which technology and humanities disciplines converge. For instance, a freelancer trained in art history now has the tools to recreate a 3D rendering of Japan in the Edo period, without the need to conduct heavy coding. In other words, the reinstatement effect of AI will elevate the overall quality and value proposition of the work, and ultimately enable higher earning gains. This paradigm shift underscores generative AI's role in not just transforming work processes but also in creating new economic dynamics within the 3D content market. Fortunately, it seems many freelancers on Upwork are ready to reap the benefits: 3D-related skills, such as 3D modeling, rendering, and design, are listed among the top five skills of freelancer profiles as well as in job posts.
A dynamic interplay: task complexity, skills, and gen AI
Focusing on the Upwork marketplace for independent talent, we study the impact of generative AI by using the public release of ChatGPT as a natural experiment. The results suggest a dynamic interplay of replacement and reinstatement effects; we argue that this dynamic is influenced by task complexity, suggesting a skill-biased impact of gen AI. Analysis across Upwork's work sectors shows varied effects: growth in freelance earnings in tech solutions and business operations, but a mixed impact in the creative sector. Specifically, high-value work in data science and business operations see significant earnings growth, while creative contracts like writing and translation experience a decrease in earnings, particularly in lower-value tasks. Using the case study of 3D content creation, we show that generative AI can significantly enhance productivity and quality of work, leading to economic gains and a shift toward higher-value tasks, despite initial concerns of displacement.
Acemoglu and Restrepo (2019) argue that the slowdown of earning growth in the United States the past three decades can partly be explained by new technologies’ replacement effect overpowering the reinstatement effect. But with generative AI, we’re at a point of completely redefining what human tasks mean, and there may be ample opportunities to create new tasks and work. It's evident that while high-value types of work are being created, freelancers engaged in low-value tasks may face negative impact, possibly due to a lack of skills needed to capitalize on AI benefits. This situation underscores the necessity of supporting freelancers not only in elevating their marketability within their current domains but also in transitioning to other work categories.
To ensure as many people as possible benefit, there’s an imperative need to provide educational resources for them to gain the technical skills, and more importantly skills of adaptability to reinvent their work. This helps minimize the chance of missed opportunities by limiting skills mismatch between talent and new demands created by new technologies. Upwork has played a significant role here by linking freelancers to resources such as Upwork Academy’s AI Education Library and Education Marketplace, thereby equipping them with the necessary tools and knowledge to adapt and thrive in an AI-present job market. This approach can help bridge the gap between low- and high-value work opportunities, ensuring a more equitable distribution of the advantages brought about by generative AI.
Methodology
To estimate the causal impact of generative AI, we take a synthetic control approach in the spirit of Abadie, Diamond, and Hainmueller (2010). The synthetic control method allows us to construct a weighted combination of comparison units from available data to create a counterfactual scenario, simulating what would have happened in the absence of the intervention. We use this quasi-experimental method due to the infeasibility of conducting a controlled large-scale experiment. Additionally, we use Lasso regularization to credibly construct the donor pool that serves the basis of the counterfactuals and minimize the chance of overfitting the data.
Moreover, we supplement the analysis by scoring whether a sub-occupation is impacted or unaffected by generative AI. The scoring utilizes specific criteria: 1. Whether a certain share of job posts are tagged as AI contracts by the Upwork platform; 2. AI occupational exposure score, based on a study by Felten, Raj, and Seamans (2023), to tag these sub-occupations. We also use data smoothing techniques through three-month moving averages. We analyzed data collected on our platform from 2021 through Q3 2023. We specifically look at freelancer data across all 12 work categories on the platform for high-value contracts, defined as those with a contract of at least $1,000, and low-value contracts, consisting of those between $251 and under $500.
The main advantage of our approach is that it is a robust yet flexible way to identify the causal effects on not only the Upwork freelance market but also specific work categories. Additionally, we control for macroeconomic or aggregate shocks such as U.S. monetary policy in the pre-treatment period. However, we acknowledge the potential biases in identifying which sub-occupations are influenced by generative AI and the effects of external factors in the post-treatment period.
About the Upwork Research Institute
The Upwork Research Institute is committed to studying the fundamental shifts in the workforce and providing business leaders with the tools and insights they need to navigate the here and now while preparing their organization for the future. Using our proprietary platform data, global survey research, partnerships, and academic collaborations, we produce evidence-based insights to create the blueprint for the new way of work.
About Ted Liu
Dr. Ted Liu is Research Manager at Upwork, where he focuses on how work and skills evolve in relation to technological progress such as artificial intelligence. He received his PhD in economics from the University of California, Santa Cruz.
About Carina Deng
Carian Deng is the Lead Analyst in Strategic Analytics at Upwork, where she specializes in uncovering data insights through advanced statistical methodologies. She holds a Master's degree in Data Science from George Washington University.
About Kelly Monahan
Dr. Kelly Monahan is Managing Director of the Upwork Research Institute, leading our future of work research program. Her research has been recognized and published in both applied and academic journals, including MIT Sloan Management Review and the Journal of Strategic Management.
efficiency
efficiency
efficiency
扫一扫
添加客服
