Thursday, November 21, 2024
Home Blog Page 1108

Correcting biases in image generator models

0
Correcting biases in image generator models


Correcting biases in image generator models
Editing a model based on a source and destination prompt. The edit generalizes to related prompts (green), leaving unrelated ones unaffected (gray). Credit: Hadas Orgad et al

Image generator models—systems that produce new images based on textual descriptions—have become a common and well-known phenomenon in the past year. Their continuous improvement, largely relying on developments in the field of artificial intelligence, makes them an important resource in various fields.

To achieve good results, these models are trained on vast amounts of image-text pairs—for example, matching the text “picture of a dog” to a picture of a dog, repeated millions of times. Through this training, the model learns to generate original images of dogs.

However, as noted by Hadas Orgad, a doctoral student from the Henry and Marilyn Taub Faculty of Computer Science, and Bahjat Kawar a graduate of the same Faculty, “since these models are trained on a lot of data from the real world, they acquire and internalize assumptions about the world during the training process.

“Some of these assumptions are useful, for example, ‘the sky is blue,’ and they allow us to obtain beautiful images even with short and simple descriptions. On the other hand, the model also encodes incorrect or irrelevant assumptions about the world, as well as societal biases. For example, if we ask Stable Diffusion (a very popular image generator) for a picture of a CEO, we will only get pictures of women in 4% of cases.”

Another problem these models face is the significant number of changes occurring in the world around us. The models cannot adapt to the changes after the training process.

As Dana Arad, also a doctoral student at the Taub Faculty of Computer Science, explains, “during their training process, models also learn a lot of factual knowledge about the world. For example, models learn the identities of heads of state, presidents, and even actors who portrayed popular characters in TV series.

“Such models are no longer updated after their training process, so if we ask a model today to generate a picture of the President of the United States, we might still reasonably receive a picture of Donald Trump, who of course has not been the president in recent years. We wanted to develop an efficient way to update the information without relying on expensive actions.”

The “traditional” solution to these problems is constant data correction by the user, retraining, or fine-tuning. However, these fixes incur high costs financially, in terms of workload, in terms of result quality, and in environmental aspects (due to the longer operation of computer servers). Additionally, implementing these methods does not guarantee control over unwanted assumptions or new assumptions that may arise. “Therefore,” they explain, “we would like a precise method to control the assumptions that the model encodes.”

The methods developed by the doctoral students under the guidance of Dr. Yonatan Belinkov address this need. The first method, developed by Orgad and Kawar and called TIME (Text-to-Image Model Editing), allows for the quick and efficient correction of biases and assumptions.

The reason for this is that the correction does not require fine-tuning, retraining, or changing the language model and altering the text interpretation tools, but only a partial re-editing of around 1.95% of the model’s parameters. Moreover, the same editing process is performed in less than a second.

In ongoing research based on TIME, called UCE, which has been developed in collaboration with Northeastern and MIT universities, they proposed a way to control a variety of undesirable ethical behaviors of the model—such as copyright infringement or social biases—by removing unwanted associations from the model such as offensive content or artistic styles of different artists.

Another method, developed subsequently by Arad and Orgad, is called ReFACT. It offers a different algorithm for parameter editing and achieves more precise results.

ReFACT edits an even smaller percentage of the model’s parameters—only 0.25%—and manages to perform a wider variety of edits, even in cases where previous methods failed. It does so while maintaining the quality of the images and the facts and assumptions of the model that we want to preserve.

The methods receive inputs from the user regarding a fact or assumption they want to edit. For example, in cases of implicit assumptions, the method receives a “source” on which the model bases implicit assumptions (e.g., “red roses” by default the model assumes red roses) and a “target” that describes the same circumstances but with the desired features (e.g., “blue roses”).

When wanting to use the method for role editing, the method receives an editing request (e.g., “President of the United States”) and then a “source” and “target” (“Donald Trump” and “Joe Biden,” respectively). The researchers collected about 200 works and assumptions on which they tested the editing methods and showed that these are efficient methods for updating information and correcting biases.

TIME was presented in October 2023 at the ICCV conference, a conference in the field of computer vision and machine learning. UCE was recently presented at the WACV conference.

ReFACT was presented in Mexico at the NAACL conference, a conference in natural language processing research.

More information:
Editing Implicit Assumptions in Text-to-Image Diffusion Models

ReFACT: Updating Text-to-Image Models by Editing the Text Encoder

Citation:
Correcting biases in image generator models (2024, June 24)
retrieved 24 June 2024
from https://techxplore.com/news/2024-06-biases-image-generator.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.





Source link

Model combines physical parameters and machine learning to predict storm tides

0
Model combines physical parameters and machine learning to predict storm tides


Model combines physical parameters and machine learning to predict storm tides
The study combined physical and numerical models, working with data in different formats via a multimodal architecture. Credit: Tânia Rego/Agência Brasil

Predicting extreme events is essential to the preparation and protection of vulnerable regions, especially at a time of climate change. The city of Santos on the coast of São Paulo state (Brazil) is Latin America’s largest port and has been the focus for significant case studies, not least because of the storm surges that threaten its infrastructure and the local ecosystems.

An article reporting the results of a study that focused on a critical part of Santos and used advanced machine learning tools to optimize existing extreme event prediction systems has been published in Proceedings of the AAAI Conference on Artificial Intelligence.

It mobilized a large number of researchers and was coordinated by Anna Helena Reali Costa, full professor at the University of São Paulo’s Engineering School (POLI-USP). The first author is Marcel Barros, a researcher in POLI-USP’s Department of Computer Engineering and Digital Systems.

The models used to predict sea surface heights, high tides, wave heights and so on are based on differential equations comprising temporal and spatial information such as astronomic tide (determined by the relative positions of the sun, moon and Earth), wind regime, current velocity and salinity, among many others.

These models are successful in several areas but they are complex and depend on a number of simplifications and hypotheses. Moreover, new measurements and other data sources cannot always be integrated into them to make forecasts more reliable.

Although modelers are increasingly using machine learning methods capable of identifying patterns in data and extrapolating to new situations, a great many examples are required to train the algorithms that perform complex tasks such as those involved in weather forecasting and storm tide prediction.

“Our study combined the two worlds to develop a model based on machine learning that uses physical models as a starting point but refines them by adding measured data. This research field is known as physics-informed machine learning, or PIML,” Barros explained.

Harmonization of these two sources of information is fundamental to develop more precise and accurate forecasts. However, the use of sensor data faces significant technical challenges, owing especially to its irregular nature and problems such as missing data, temporal displacements, and variations in sampling frequencies. Sensors that fail can take days to be brought back online, but the mechanisms for predicting storm tides must be capable of operating continuously without the missing data.

“To address situations with highly irregular data, we developed an innovative technique to represent the passing of time in neural networks. This representation lets the model be told the position and size of the missing data windows, so that it considers them in its predictions of tide and wave heights,” Barros said.

The innovation permits better modeling of complex natural phenomena and can also be used to model other phenomena that involve irregular time series, such as health data, sensor networks in manufacturing, or financial indicators.

“Furthermore, our model combines different kinds of neural networks so as to integrate multimodal data, such as satellite images, tables and forecasts from numerical models, with possible future integration of other types of data, such as text and audio. This approach is an important step toward more robust and adaptable forecasting systems that can handle the complexity and variability of the data associated with extreme weather events,” Reali Costa said.

The model has three key virtues, she added, it combines physical and numerical models; it represents time in neural networks in a new way; and it works with data in different formats by means of multimodal architecture.

“The study offers a methodology that can improve the accuracy of predictions of extreme events, such as storm tides in Santos. At the same time, it highlights the challenges and potential solutions for the integration of physical models and sensor data in complex contexts,” she said.

More information:
Marcel Barros et al, Early Detection of Extreme Storm Tide Events Using Multimodal Data Processing, Proceedings of the AAAI Conference on Artificial Intelligence (2024). DOI: 10.1609/aaai.v38i20.30194

Citation:
Model combines physical parameters and machine learning to predict storm tides (2024, June 21)
retrieved 24 June 2024
from https://techxplore.com/news/2024-06-combines-physical-parameters-machine-storm.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.





Source link

Apple becomes first target of EU’s new digital competition rules aimed at big tech

0


Apple becomes first target of EU's new digital competition rules aimed at big tech
The logo of Apple is illuminated at a store in the city center in Munich, Germany, on Dec. 16, 2020. European Union regulators have accused Apple of breaking new rules on digital competition by preventing software developers on its App Store from steering users to other venues. Credit: AP Photo/Matthias Schrader, File

European Union regulators on Monday leveled their first charges under the bloc’s new digital competition rulebook, accusing Apple of preventing app makers from pointing users to cheaper options outside its App Store.

The European Commission said that according to the preliminary findings of its investigation, the restrictions that the iPhone maker imposes on developers using its mobile App Store had breached the 27-nation bloc’s Digital Markets Act.

The rulebook, also known as the DMA, is a sweeping set of regulations aimed at preventing tech “gatekeepers” from cornering digital markets under threat of heavy financial penalties. The commission opened an initial round of investigations after it took effect in March, including a separate ongoing probe into whether Apple is doing enough to allow iPhone users to easily change web browsers, and other cases involving Google and Meta.

Apple has been facing pressure on both sides of the Atlantic to tear down some of the competitive barriers around its lucrative iPhone franchise. The U.S. Justice Department has filed a sweeping antitrust lawsuit against Apple this year, accusing it of illegally monopolizing the smartphone market and boxing out competitors, stifling innovation and keeping prices artificially high. App makers such as Spotify had complained for years about Apple’s requirement that subscriptions only be bought through iOS apps, allowing the company to take a commission of up to 30%.

Under the DMA’s provisions, app developers must be allowed to inform customers of cheaper purchasing options and direct them to those offers.

The commission, the bloc’s executive arm, said App Store rules “prevent app developers from freely steering consumers to alternative channels for offers and content.”

Apple now has a chance to respond to the findings. The commission must make a final decision on Apple’s compliance by March 2025. The company could face fines worth up to 10% of its global revenue, which could amount to billions of euros, or daily penalties.

The commission kept up the pressure on Apple, simultaneously opening a new investigation into contractual terms that it’s offering app developers.

Regulators zeroed in on a “core technology fee” of 50 euro cents (54 cents) that Apple is now charging developers for each time their apps are downloaded and installed from outside Apple’s App Store. The DMA’s provisions open the way for alternative app stores to give consumers more choice.

The commission said the the new terms are a “condition to access some of the new features enabled by the DMA.” Rivals had criticized the fee, saying it would deter many existing free apps, which don’t pay any fees, from jumping ship.

“We are concerned Apple’s new business model makes it too hard for app developers to operate as alternative marketplaces & reach their end users on iOS,” the European Commissioner for Competition, Margrethe Vestager, said on social media.

Apple Inc. said over the past several months, it “has made a number of changes to comply with the DMA in response to feedback from developers and the European Commission.”

“We are confident our plan complies with the law, and estimate more than 99% of developers would pay the same or less in fees to Apple under the new business terms we created,” the company said in a statement. “All developers doing business in the EU on the App Store have the opportunity to utilize the capabilities that we have introduced, including the ability to direct app users to the web to complete purchases at a very competitive rate.”

The company said it will “continue to listen and engage” with the commission.

The EU had been carrying out a similar investigation since 2020 into whether Apple’s in-app purchasing system and restrictions violated Brussels’ antitrust rules. But “to avoid multiple investigations into the very same conduct,” that probe is being shut down to focus on the investigation under the DMA, which clearly spells out what Apple can’t do, the commission said Monday.

© 2024 The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed without permission.

Citation:
Apple becomes first target of EU’s new digital competition rules aimed at big tech (2024, June 24)
retrieved 24 June 2024
from https://techxplore.com/news/2024-06-apple-eu-digital-competition-aimed.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.





Source link

We Count on You! Protecting Privacy, Enabling Analytics

0

Quantum science emerged from studies of the smallest objects in nature. Today, it promises to deepen our understanding of the universe and deliver groundbreaking technology, from quantum computers to ultra-precise measuring devices to next-generation materials, with many of these advances happening at Caltech.

As far as the laws of mathematics refer to reality, they are not certain; and as far as they are certain, they do not refer to reality.

Albert Einstein

Most users search for something interesting (or useful) and clickable; as soon as some promising candidates are found, users click. If the new page doesn’t meet users’ expectations, the back button is clicked and the search process is continued.

Quantum science and technology

Not all websites are made equal. Some websites are simple, logical, and easy to use. Others are a messy hodgepodge of pages and links.

\"\"
How are innovations in robotics changing the way we perceive the world?

Without website navigation, your visitors can’t figure out how to find your blog, your email signup page, your product listings, pricing, contact information, or help docs.

[ruby_related heading=\”More Read\” total=6 layout=6]

Quick and easy access to the content they’re after is more important for your website users than a… visually-stunning design.

Bad navigation is an especially common problem. We’ve all struggled to find things on disorganized websites without any logical structure. It feels hopeless.

How do scientists conduct quantum experiments?

In design, rhythm is created by simply repeating elements in predictable patterns. This repetition is a natural thing that occurs everywhere in our world. As people, we are driven everyday by predictable, timed events.

\"\"
Success is no accident. It is hard work, perseverance, learning, studying, sacrifice and most of all, love of what you are doing.

Rhythm also factors into the layout of content. For example, you \”might have\” blog articles, press releases, and events each follow their own certain layout pattern.

What is entanglement and why is it important?

Nobody enjoys looking at an ugly web page. Garish colors, cluttered images and distracting animation can all turn customers \”off\” and send them shopping \”somewhere else\”. Basic composition rules to create more effective:

  • Direct the Eye With Leading Lines
  • Balance Out Your Elements
  • Use Elements That Complement Each Other
  • Be clear about your \”focal points\” and where you place them

The size and position of elements in a composition will determine its balance. An unbalanced design generates tension, which may be the goal in many design projects, but for web apps that demand repeated comfortable use, tension is not a desirable trait.

How are quantum phenomena used in technology today?

UX and UI: Two terms that are often used interchangeably, but actually mean very different things. So what exactly is the difference?

Quantum physics thus reveals a basic oneness of the universe.

Erwin Schrodinger

UX design refers to the term “user experience design”, while UI stands for “user interface design. Both elements are crucial to a product and work closely together. But despite their relationship, the roles themselves are quite different.

What is quantum physics?

Good design guides the user by communicating purpose and priority. For that reason, every part of the design should be based on an \”informed decision\” rather than an arbitrary result of personal taste or the current trend.

\"\"
Study nature. Love nature. Stay close to nature. It will never fail you.

Provide distinct styles for interactive elements, such as links and buttons, to make them easy to identify. For example, \”change the appearance of links\” on mouse hover, \”keyboard focus\”, and \”touch-screen activation\”.

Breaking down the barriers

Design is not the end-all solution to all of the worlds problems — but with the right thinking and application, it can definitely be a good beginning to start tackling them.

Transform Your VR Setup into a Gamer\’s Paradise with These Accessories

0

Although we’re almost two years into a new console generation, we’re heading into a relatively light summer in terms of \”flagship releases\”. If you’re willing to dig a little deeper, there are still a whole bunch of games worth getting excited for.

So, for the days when you’re not crossing another \”winter game\” off of your backlog or diving back into that service title you’d previously sworn off, here are 14 of the most exciting video game releases for the summer

Good design is making something intelligible and memorable. Great design is making something memorable and meaningful.

Dieter Rams

Online multiplayer shooters, like CS:GO, Fortnite, and PUBG, are currently dominating the gaming world, thanks to professional gamers, esports tournaments, Twitch streamers, and YouTube gaming channels. Others have spawned sequels that out play and out perform their original games. Some games that have been released years ago are still popular today.

The design: Small refinement goes a long way

Not all websites are made equal. Some websites are simple, logical, and easy to use. Others are a messy hodgepodge of pages and links.

Without website navigation, your visitors can’t figure out how to find your blog, your email signup page, your product listings, pricing, contact information, or help docs.

Quick and easy access to the content they’re after is more important for your website users than a… visually-stunning design.

Website navigation allows visitors to flow from one page to another without frustration. If you’ve done your job well, visitors leave your site with the intention to return and might even buy something from you or sign up for your email list.

Bad navigation is an especially common problem. We’ve all struggled to find things on disorganized websites without any logical structure. It feels hopeless.

Using \”complex large pictures\”. Because a carousel generally carries a lot of picture messages, complex large pictures result in low performance and \”slow loading rate\” of the sites, especially those whose first homepages are occupied by high-resolution carousels.

Megapixel camera: More pixels isn\’t everything

In design, rhythm is created by simply repeating elements in predictable patterns. This repetition is a natural thing that occurs everywhere in our world. As people, we are driven everyday by predictable, timed events.

\"\"

One of the best ways to use repetition and rhythm in web design is in the site\’s navigation menu. A consistent, easy-to-follow pattern—in color, layout, etc. Gives users an intuitive roadmap to everything you want to share on your site.

Everything we recommend

Apple says that the Watch Series 8 offers a battery life of \”18 hours after an overnight charge,\” which includes 90-time checks, 90 notifications, a 60-minute workout with music playback, and 45 minutes of app usage. The smartwatch is also rated to last up to 1.5 hours on a call via an LTE connection.

Rhythm also factors into the layout of content. For example, you \”might have\” blog articles, press releases, and events each follow their own certain layout pattern.

Compare Apple Watch products

Apple Watch SEApple Watch Series 8Apple Watch Ultra
Case Size40mm, 44mm41mm, 45mm49mm
Case Thickness10.7mm10.7mm10.4mm
DisplayRetina LTPO OLED display, 1000 nitsAlways-On Retina LTPO OLED display, 1000 nitsAlways-On Retina LTPO OLED display, 2000 nits
ProcessorS8 SiP with 64-bit dual-core processorS8 SiP with 64-bit dual-core processorS8 SiP with 64-bit dual-core processor
Optical Heart SensorThird-generation optical heart sensorThird-generation optical heart sensorThird-generation optical heart sensor
Digital CrownDigital Crown with haptic feedbackDigital Crown with haptic feedbackDigital Crown with haptic feedback
AltimeterAlways-on AltimeterAlways-on AltimeterAlways-on Altimeter
SpeakerBuilt-in speakerBuilt-in speakerDual speakers
Fall Detection
Compass
Noise Monitoring
Blood oxygen sensor (Blood Oxygen app)
Electrical heart sensor (ECG app)
Capacity32GB32GB32GB

Which is the best Apple Watch 2023?

Nobody enjoys looking at an ugly web page. Garish colors, cluttered images and distracting animation can all turn customers \”off\” and send them shopping \”somewhere else\”. Basic composition rules to create more effective:

  • Low-power mode for extended battery life
  • Strong performance
  • Slick design
  • Sub-par 18-hour battery life

UX design refers to the term “user experience design”, while UI stands for “user interface design. Both elements are crucial to a product and work closely together. But despite their relationship, the roles themselves are quite different.

Why you should trust us

Good design guides the user by communicating purpose and priority. For that reason, every part of the design should be based on an \”informed decision\” rather than an arbitrary result of personal taste or the current trend.

\"\"

Provide distinct styles for interactive elements, such as links and buttons, to make them easy to identify. For example, \”change the appearance of links\” on mouse hover, \”keyboard focus\”, and \”touch-screen activation\”.

Design is not the end-all solution to all of the worlds problems — but with the right thinking and application, it can definitely be a good beginning to start tackling them.